DataJobs.io
← Back to all jobs

Job Description

Bilink Corp is seeking a Senior Databricks Data Engineer / Lakehouse Architect to build and operate a Databricks lakehouse in production. In this hybrid Chicago role, you will help establish a Databricks platform on Azure, with SAP serving as a primary data source during the initial engagement. The work spans ETL/ELT delivery, governance, security, and ongoing performance and cost tuning.

Role overview

  • Own the work from architecture through delivery: design, build, and run the lakehouse in production
  • Serve as a trusted technical voice with client business, analytics, and IT teams
  • Set engineering standards and mentor other engineers

Responsibilities

  • Build ETL/ELT pipelines on Databricks using Spark and PySpark
  • Implement Delta Lake and a medallion architecture approach
  • Support incremental loads and CDC using MERGE
  • Set up governance and security with Unity Catalog
  • Tune for performance and cost while keeping data quality high

Requirements

  • 7+ years in data engineering, including 4+ years hands-on with Databricks on production projects
  • Experience designing a data platform, not only building pipelines inside a single system
  • Azure strongly preferred (AWS or GCP considered)
  • Strong Python and SQL, with solid data modeling and data warehousing experience
  • Clear communication with technical and non-technical stakeholders
  • Bachelor’s or Master’s in Computer Science, Engineering, or a related field, or equivalent experience
  • Live in the Chicago area and be able to work from the River North office 3 days a week
  • Authorized to work in the US (visa sponsorship considered for an exceptional candidate already based in the Chicago area)
  • No C2C (corp-to-corp) or third-party vendors; direct W2 employee of Bilink

Technologies

  • Databricks, Spark, PySpark, Delta Lake, Unity Catalog
  • MERGE, Python, SQL
  • Azure (plus AWS and GCP experience considered)
  • Medallion architecture, CDC

Benefits

  • 401(k) with match
  • Health and dental insurance
  • Paid time off

Nice to have

  • SAP data integration experience (S/4HANA, BW, HANA) into a lakehouse
  • Consulting experience
  • Databricks certification (Data Engineer Professional or Associate)

Compensation and location

  • Location: Chicago, IL (hybrid), River North office
  • Salary: USD 110,000 - 160,000 per year

Hiring process

  • Short written screening (application questions)
  • 20-minute intro call
  • On-site at the River North office: a 40-minute case study, then a presentation and technical discussion with the team

Similar Jobs