Senior Databricks Data Engineer / Lakehouse Architect
Senior
Big Data
Bigdata
Change Data Capture
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Databricks
Engineer
ETL
Lakehouse
Pyspark
Spark
SQL
Job Description
Bilink Corp is seeking a Senior Databricks Data Engineer / Lakehouse Architect to build and operate a Databricks lakehouse in production. In this hybrid Chicago role, you will help establish a Databricks platform on Azure, with SAP serving as a primary data source during the initial engagement. The work spans ETL/ELT delivery, governance, security, and ongoing performance and cost tuning.
Role overview
- Own the work from architecture through delivery: design, build, and run the lakehouse in production
- Serve as a trusted technical voice with client business, analytics, and IT teams
- Set engineering standards and mentor other engineers
Responsibilities
- Build ETL/ELT pipelines on Databricks using Spark and PySpark
- Implement Delta Lake and a medallion architecture approach
- Support incremental loads and CDC using MERGE
- Set up governance and security with Unity Catalog
- Tune for performance and cost while keeping data quality high
Requirements
- 7+ years in data engineering, including 4+ years hands-on with Databricks on production projects
- Experience designing a data platform, not only building pipelines inside a single system
- Azure strongly preferred (AWS or GCP considered)
- Strong Python and SQL, with solid data modeling and data warehousing experience
- Clear communication with technical and non-technical stakeholders
- Bachelor’s or Master’s in Computer Science, Engineering, or a related field, or equivalent experience
- Live in the Chicago area and be able to work from the River North office 3 days a week
- Authorized to work in the US (visa sponsorship considered for an exceptional candidate already based in the Chicago area)
- No C2C (corp-to-corp) or third-party vendors; direct W2 employee of Bilink
Technologies
- Databricks, Spark, PySpark, Delta Lake, Unity Catalog
- MERGE, Python, SQL
- Azure (plus AWS and GCP experience considered)
- Medallion architecture, CDC
Benefits
- 401(k) with match
- Health and dental insurance
- Paid time off
Nice to have
- SAP data integration experience (S/4HANA, BW, HANA) into a lakehouse
- Consulting experience
- Databricks certification (Data Engineer Professional or Associate)
Compensation and location
- Location: Chicago, IL (hybrid), River North office
- Salary: USD 110,000 - 160,000 per year
Hiring process
- Short written screening (application questions)
- 20-minute intro call
- On-site at the River North office: a 40-minute case study, then a presentation and technical discussion with the team