Staff Data Engineer
Job Description
Storm3 is seeking a Staff Data Engineer to help build and run healthcare data pipelines that handle PHI in a HIPAA-regulated environment. This role works at a high-ownership level alongside the CTO, with responsibility for pipeline design and day-to-day operations across the organization’s lakehouse architecture. The work focuses on reliable ingestion, patient identity resolution, and production incident escalation for client-facing data workflows.
What you’ll do
- Own the design, development, and operation of PHI data pipelines in Python, using Ibis, DuckDB, Pandas, Dagster, and Kubernetes
- Lead patient identity resolution and record-linkage workflows to ensure accurate alignment of healthcare data
- Own the data-ingestion lifecycle from file intake through validation, enrichment, masking, audit, and delivery
- Automate data operations and recovery processes with enterprise-grade observability, governance, and retry mechanisms
- Serve as the escalation point for critical production issues impacting client-facing healthcare data pipelines
- Partner closely with the CTO on key engineering decisions related to the organization’s lakehouse architecture
Requirements
- Experience working with patient-level healthcare data under HIPAA regulations
- Strong Python expertise building production-grade data systems
- Advanced SQL skills, including query optimization and troubleshooting
- Hands-on experience with orchestration tools such as Dagster, Airflow, or Prefect (Dagster strongly preferred)
- Experience building and supporting ingestion pipelines, validation frameworks, audit processes, and failure recovery workflows
- Experience deploying and operating workloads on Kubernetes
- Strong observability and troubleshooting mindset, with the ability to own business-critical systems
- Comfortable using AI-assisted development tools while maintaining full ownership of technical decisions and output quality
Technologies
- Python, Ibis, DuckDB, Pandas, Dagster, Kubernetes, SQL, Airflow, Prefect
Compensation and benefits
- $185,000 base salary per year
- Quarterly bonus
- Equity opportunity
- Remote-first environment working alongside a highly technical engineering team
- Direct partnership with the CTO and high ownership over critical systems
Location: San Francisco, CA (remote)