DataJobs.io
← Back to all jobs

Job Description

Design and deliver AWS Databricks Lakehouse data platforms, enabling enterprise analytics and AI-ready data products.

Responsibilities

  • Design, develop, and optimize scalable data pipelines using PySpark, Databricks, and AWS cloud services.
  • Build and maintain ETL/ELT workflows across Bronze, Silver, Gold, and curated layers in the Databricks Lakehouse architecture.
  • Develop, manage, and optimize Delta Lake tables and data processing workloads for enterprise-scale analytics.
  • Implement and govern data assets with Unity Catalog, including data lineage, access management, schemas, catalogs, and security controls.
  • Build and support CI/CD pipelines, deployment automation, Databricks Asset Bundles (DAB), release management, and environment promotion across development, testing, and production.

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent professional experience).
  • 5-8 years of experience in Data Engineering with hands-on expertise in AWS and Databricks.
  • Strong proficiency in PySpark, Spark SQL, and distributed data processing frameworks.
  • Experience designing, developing, and supporting enterprise-scale ETL/ELT pipelines and Lakehouse architectures.
  • Hands-on experience with Delta Lake, Unity Catalog, data governance, lineage tracking, and RBAC (role-based access control).
  • Experience implementing CI/CD pipelines, deployment automation, Databricks Asset Bundles (DAB), and release management processes.
  • Expertise in performance tuning, monitoring, troubleshooting, and production support for Databricks workloads and data pipelines.

Technologies

  • AWS
  • Databricks
  • PySpark
  • AWS cloud services
  • Delta Lake
  • Unity Catalog
  • Unity Catalog data lineage
  • Spark SQL
  • CI/CD pipelines
  • Databricks Asset Bundles (DAB)
  • Delta Lake tables
  • RBAC
  • ETL/ELT
  • Databricks Lakehouse architecture

Benefits

  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan

Work Model

  • Remote position open to qualified applicants in the United States, based on role business requirements.
  • Working arrangement may change based on the project engaged in, as well as business and client requirements.

These Will Help You Stand Out

  • Experience developing or supporting GenAI-powered analytics solutions, AI agents, or conversational data experiences.
  • Experience with Databricks semantic models, AI-enabled data products, and modern data governance frameworks.
  • Knowledge of Databricks Lakebase PostgreSQL.
  • Experience with Terraform, Infrastructure as Code (IaC), and automated Databricks environment provisioning.
  • AWS and/or Databricks certifications such as AWS Certified Data Engineer, AWS Certified Solutions Architect, or Databricks Data Engineer Associate/Professional.

Salary and Other Compensation

  • Applications accepted until November 29, 2026.
  • Annual salary between $83,000 - $94,500, depending on experience and other qualifications of the selected candidate.
  • Eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Location: Norfolk, VA (remote)

Similar Jobs