Senior Data Engineer (Azure Data Factory Databricks, PostgreSQL, Python)
Python
Senior
Analytics
Azure Data Factory
Azure Synapse Analytics
Big Data
Bigdata
Business Analytics
Business Intelligence
CI/CD
Cloud
Cloud Infrastructure
Cloud Native
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Technology
Dashboards
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
Databricks
Datadog
DevOps
DevSecOps
Engineer
Engineering
ETL
Grafana
Informatica
Infrastructure As Code
Kubernetes
Microsoft
Microsoft Azure
Platform Engineering
PostgreSQL
Power BI
Power Platform
Programming Language
Programming Languages
Reporting and Analytics
Sap Data Services
Software Development
Spark
SQL
Job Description
Career Developers is seeking a Senior Data Engineer to design and maintain scalable, production-grade data pipelines within Azure-based environments, leveraging Data Factory and Databricks alongside PostgreSQL and Python to empower analytics and reporting. This on-site role in Reston, VA requires a Bachelor's degree and at least several years of hands-on data engineering experience building reliable data products in enterprise settings.
Responsibilities
- Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
- Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
- Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
- Build and maintain relational database schemas, queries, and stored procedures
- Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
- Collaborate with analytics, BI, and engineering teams to deliver reliable data products
- Implement monitoring, logging, and observability for data pipelines
- Maintain documentation, data lineage, and governance standards
- Participate in architecture discussions and contribute to long-term data platform strategy
Requirements
- Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master's preferred)
- 5+ years of data engineering experience working with production data pipelines
- 5+ years of applied data analysis and statistical data work
- 3+ years of ETL / ELT development experience
- 3+ years working with relational databases and performance tuning
- Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
- Strong programming experience with Python, PySpark, SQL, and Bash
- Experience with Kafka, SAP data services, or similar integration tools preferred
- Experience with PostgreSQL, SAP ASE, or comparable databases
- Experience with Power BI or BusinessObjects is a plus
- Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
- Knowledge of data governance, cataloging, and access control
- Experience with monitoring tools such as Datadog, Grafana, or Prometheus
- Ability to work independently while managing multiple priorities
- Strong communication and documentation skills
- Must be eligible to work in the United States
Technologies
- Azure Data Factory
- Databricks
- Data Lake Storage
- Azure Synapse
- Delta Lake
- Spark
- PostgreSQL
- SAP Data Services
- SAP ASE
- Power BI
- BusinessObjects
- Python
- PySpark
- SQL
- Bash
- Kafka
- Kubernetes
- Git
- CI/CD
- Datadog
- Grafana
- Prometheus
Similar Jobs
