DataJobs.io
← Back to all jobs

Job Description

Build and support cloud-based healthcare data platforms using Azure and Databricks.

  • Location: Philadelphia, PA (hybrid)
  • Experience: 7+ years

Responsibilities

  • Build and maintain ETL/ELT data pipelines.
  • Develop data solutions using Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage (ADLS Gen2).
  • Create and optimize PySpark and SQL data processing frameworks.
  • Implement Delta Lake and Lakehouse architectures.
  • Support data migration, modernization, and cloud transformation initiatives.
  • Ensure data quality, reliability, and performance across pipelines and downstream reporting.
  • Build data models and curated datasets used for reporting and analytics.
  • Implement CI/CD, monitoring, and DevOps best practices for data services.
  • Collaborate with business users, architects, and product teams in an Agile environment.

Requirements

  • Azure Databricks
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS Gen2)
  • PySpark and Python
  • SQL
  • Delta Lake
  • Data Modeling
  • ETL/ELT development
  • Azure Cloud Platform
  • Git & CI/CD
  • Agile/Scrum

Preferred Skills

  • Azure Synapse Analytics
  • Power BI
  • Azure DevOps
  • Infrastructure as Code (IaC)
  • FHIR/HL7
  • AI/ML Data Pipelines

Required Experience

  • 7+ years in Data Engineering
  • 5+ years with Azure Data Technologies
  • 2+ years in Healthcare, including Payer, Health Plan, or Managed Care domains
  • Experience with large-scale data pipelines and integration solutions

Nice to Have

  • Claims Data
  • Membership Data
  • Provider Data
  • Care Management Data

Technologies

  • Azure Databricks
  • Azure Data Factory (ADF)
  • Azure Data Lake Storage (ADLS Gen2)
  • PySpark, Python, SQL
  • Delta Lake
  • Azure Cloud Platform
  • Git, CI/CD
  • Lakehouse architectures
  • DevOps
  • Azure Synapse Analytics
  • Power BI
  • Azure DevOps
  • Infrastructure as Code (IaC)
  • FHIR/HL7
  • AI/ML Data Pipelines

Similar Jobs