AWS Databricks Data Engineer
Azure Databricks
Big Data
Bigdata
CI/CD
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Management
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Databricks Pyspark
Delta Lake
DevOps
Devops Tools
Engineer
ETL
Etl/elt
Informatica
Lakehouse
Rbac
Software Development
Software Engineering
Spark
SQL
Job Description
Design and deliver AWS Databricks Lakehouse data platforms, enabling enterprise analytics and AI-ready data products.
Responsibilities
- Design, develop, and optimize scalable data pipelines using PySpark, Databricks, and AWS cloud services.
- Build and maintain ETL/ELT workflows across Bronze, Silver, Gold, and curated layers in the Databricks Lakehouse architecture.
- Develop, manage, and optimize Delta Lake tables and data processing workloads for enterprise-scale analytics.
- Implement and govern data assets with Unity Catalog, including data lineage, access management, schemas, catalogs, and security controls.
- Build and support CI/CD pipelines, deployment automation, Databricks Asset Bundles (DAB), release management, and environment promotion across development, testing, and production.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent professional experience).
- 5-8 years of experience in Data Engineering with hands-on expertise in AWS and Databricks.
- Strong proficiency in PySpark, Spark SQL, and distributed data processing frameworks.
- Experience designing, developing, and supporting enterprise-scale ETL/ELT pipelines and Lakehouse architectures.
- Hands-on experience with Delta Lake, Unity Catalog, data governance, lineage tracking, and RBAC (role-based access control).
- Experience implementing CI/CD pipelines, deployment automation, Databricks Asset Bundles (DAB), and release management processes.
- Expertise in performance tuning, monitoring, troubleshooting, and production support for Databricks workloads and data pipelines.
Technologies
- AWS
- Databricks
- PySpark
- AWS cloud services
- Delta Lake
- Unity Catalog
- Unity Catalog data lineage
- Spark SQL
- CI/CD pipelines
- Databricks Asset Bundles (DAB)
- Delta Lake tables
- RBAC
- ETL/ELT
- Databricks Lakehouse architecture
Benefits
- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan
Work Model
- Remote position open to qualified applicants in the United States, based on role business requirements.
- Working arrangement may change based on the project engaged in, as well as business and client requirements.
These Will Help You Stand Out
- Experience developing or supporting GenAI-powered analytics solutions, AI agents, or conversational data experiences.
- Experience with Databricks semantic models, AI-enabled data products, and modern data governance frameworks.
- Knowledge of Databricks Lakebase PostgreSQL.
- Experience with Terraform, Infrastructure as Code (IaC), and automated Databricks environment provisioning.
- AWS and/or Databricks certifications such as AWS Certified Data Engineer, AWS Certified Solutions Architect, or Databricks Data Engineer Associate/Professional.
Salary and Other Compensation
- Applications accepted until November 29, 2026.
- Annual salary between $83,000 - $94,500, depending on experience and other qualifications of the selected candidate.
- Eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.
Location: Norfolk, VA (remote)