Senior Data Engineer

Robotics Technologies is hiring a Senior Data Engineer onsite in New York, NY to build a modern, scalable healthcare enrollment data platform with a focus on X12 EDI processing.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and support X12 EDI processing capabilities, with emphasis on 837, 835, and 834 transactions.
• Develop high-volume, production-grade data engineering solutions.
• Work with Delta Lake, Apache Spark, Databricks Notebooks, and Databricks Pipelines.
• Process and transform healthcare enrollment, eligibility, and claims-related data.
• Ensure data security and compliance aligned with HIPAA guidelines, including proper handling of PII and PHI.
• Troubleshoot, optimize, and maintain existing data pipelines.
• Operate independently within a fast-paced program environment.

Requirements

• 6+ years of experience in Data Engineering.
• Strong hands-on experience with Databricks including Delta Lake, Spark, Notebooks, and Pipelines.
• Strong working knowledge of X12 EDI standards, specifically 837, 835, and 834.
• Proficiency in Python and PySpark.
• Experience building and maintaining high-volume, production-grade data pipelines.
• Healthcare domain experience, including knowledge of PII, PHI, and HIPAA compliance.
• Familiarity with healthcare enrollment and eligibility data workflows.
• Ability to work independently and deliver in a fast-paced environment.

Technologies

• Databricks
• PySpark
• Python
• X12 EDI
• Delta Lake
• Apache Spark
• Databricks Notebooks
• Databricks Pipelines

Good to Have

• Previous experience with healthcare clearinghouse integrations.
• Experience with healthcare EDI transaction processing and integrations.