L
Senior Data Engineer
Senior
Aws Data Engineer
Azure Data Engineer
Azure Databricks
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Dlt
Databricks Lakehouse
Databricks Pyspark
Databricks Workflows
Delta Lake
Engineer
ETL
Gcp Data Engineer
Informatica
Information Technology (IT)
Programming Language
Programming Languages
Software Development
Spark
SQL
Job Description
Lorgan Tech Solutions, LLC is seeking a Senior Data Engineer to build and optimize enterprise-grade data platforms with Databricks and Delta Lake.
Responsibilities
- Develop and maintain scalable ETL/ELT pipelines using Databricks, PySpark, and SQL
- Implement Bronze, Silver, and Gold layers using Delta Lake and medallion architecture
- Build reliable batch and streaming pipelines with incremental processing, deduplication, and recovery capabilities
- Design data models and curated datasets for reporting, analytics, and downstream applications
- Optimize Spark workloads, including cluster configuration and query performance
- Implement data quality checks, monitoring, logging, and error handling
- Manage data access, governance, and lineage using Unity Catalog
- Automate deployments using Git and CI/CD practices
- Collaborate with architects, analysts, and business stakeholders
- Mentor engineers and contribute to technical design and code reviews
Requirements
- 10+ years of professional Data Engineering experience
- Strong hands-on experience with Databricks, Apache Spark, PySpark, and SQL
- Proficiency in Python and distributed data processing
- Experience with Delta Lake, medallion architecture, and data modeling
- Experience with at least one cloud platform: Azure, AWS, or GCP
- Knowledge of orchestration using Databricks Workflows, Airflow, or Azure Data Factory
- Experience implementing incremental loads, CDC, and data validation
- Familiarity with Unity Catalog, security, and data governance
- Experience with Git, CI/CD, and production troubleshooting
- Strong communication, problem-solving, and collaboration skills
Technologies
- Databricks
- PySpark
- SQL
- Apache Spark
- Python
- Delta Lake
- Unity Catalog
- Git
- CI/CD
- Databricks Workflows
- Airflow
- Azure Data Factory
- Azure
- AWS
- GCP
Preferred Qualifications
- Experience with Auto Loader, Structured Streaming, or declarative pipelines
- Familiarity with dbt, Terraform, and infrastructure automation
- Databricks certification
Work Location
- Remote
Compensation
- USD 60 - 65 per hour
How to Apply
- Email: [email protected]
- Subject: Senior Data Engineer – Databricks
- Include your current location, availability, and a brief summary of your Databricks experience
Similar Jobs
