Senior Data Engineer – Microsoft Fabric & Healthcare Integrations

Quantum Pain & Sports Medicine is building a centralized data and analytics platform in Microsoft Fabric, with a focus on dependable healthcare and business integrations. This Senior Data Engineering role is centered on infrastructure and ingestion pipelines in Fabric, so trusted, analytics-ready datasets can power reporting, operational analytics, automation, and future AI use cases.

You will help design the foundation early, implement the ingestion and data layers that make data reliable, and operate the platform so additional systems and new analytics needs can be added without rebuilding everything.

What you will do

• Design and implement the Microsoft Fabric data architecture using OneLake, Lakehouse/Warehouse, Data Factory pipelines, notebooks, and related Fabric services.
• Build and maintain ingestion pipelines from eClinicalWorks, HubSpot, APIs, databases, files, and future enterprise systems.
• Integrate healthcare and operational systems using REST APIs, FHIR APIs, webhooks, batch exports, and other extraction approaches.
• Implement a medallion-style structure with raw, validated, and analytics-ready layers.
• Clean, standardize, deduplicate, and reconcile data across systems, including building patient, referral, appointment, provider, procedure, case, outcome, and other operational data models.
• Create matching methods for records when identifiers are inconsistent or unavailable.
• Deliver reusable curated datasets that support Power BI reporting, operational analytics, automation, and future AI applications.
• Implement incremental loading, change detection, schema management, error handling, logging, alerting, and pipeline monitoring.
• Set up data quality checks to identify incomplete, inconsistent, or unexpected source data.
• Apply healthcare-appropriate security, access controls, and governance practices.
• Use Git and CI/CD so pipelines and transformations remain version-controlled, documented, and maintainable.
• Monitor Fabric usage, performance, capacity, and cost as the platform grows.
• Document architecture, data definitions, pipelines, dependencies, and operating procedures.
• Maintain and improve the platform after initial implementation, rather than treating it as a one-time migration.
• Assess existing systems, data sources, reporting requirements, and the Microsoft environment, then design and configure the initial Fabric architecture.

Required qualifications

• 4+ years of professional experience in data engineering, data platform, or data integration.
• Hands-on experience building production solutions with Microsoft Fabric or a closely related Azure data stack.
• Strong SQL skills.
• Strong Python and/or PySpark skills.
• Experience designing ETL/ELT pipelines and data ingestion frameworks.
• Experience with Microsoft Fabric Lakehouse, OneLake, Data Factory/Pipelines, notebooks, Delta tables, or equivalent technologies.
• Experience integrating third-party systems via REST APIs.
• Experience implementing incremental data loads rather than relying only on full refreshes.
• Strong understanding of dimensional modeling, relational modeling, lakehouse architecture, and analytics-oriented data modeling.
• Experience troubleshooting API authentication, pagination, rate limits, schema changes, malformed records, pipeline failures, and other real-world integration issues.
• Experience with Git, source control, and CI/CD practices.
• Experience implementing monitoring, logging, data-quality validation, and alerting for production pipelines.
• Ability to work independently and make practical architectural decisions while the platform is still being built.
• Healthcare experience is strongly preferred.

Healthcare and integration experience (preferred)

• Experience with healthcare EHR/EMR data and healthcare operational or clinical data models.
• Experience with eClinicalWorks.
• Experience with FHIR/HL7 and healthcare integration patterns.
• Familiarity with HIPAA-regulated data environments.
• Experience with patient identity matching or Master Patient Index concepts.
• Experience with HubSpot APIs and CRM data.
• Experience with Microsoft Entra ID and Azure security, and/or Microsoft Purview or other governance tools.
• Experience with Power BI semantic models.
• Direct eClinicalWorks experience is a major plus, but strong healthcare API/FHIR integration experience is sufficient if you can quickly learn new source systems.

Tools and technologies

• Microsoft Fabric, OneLake, Lakehouse, Warehouse, Data Factory, Pipelines, Notebooks, Delta tables
• REST APIs, FHIR APIs, Webhooks
• Python, PySpark, Git, CI/CD
• Power BI, eClinicalWorks, HubSpot, FHIR, HL7
• Microsoft Entra ID, Azure security, Microsoft Purview, Master Patient Index

Compensation and work details

• Location: Irving, TX (onsite)
• Employment type: Full-Time
• Work arrangement: In-Office
• Compensation: USD 125,000 - 150,000 per year (depending on experience)

Benefits

• 401(k) and 401(k) matching
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Vision insurance

Role focus (what this is not)

• This position is not a Power BI developer role with occasional data engineering responsibilities.
• Power BI knowledge is helpful, but the primary responsibility is building the data infrastructure underneath reporting, analytics, automation, and AI.
• The role requires comfort working at the level of APIs, pipelines, Python, SQL, data models, cloud architecture, security, and production operations.

What success looks like

• Within the first year, establish a maintainable Microsoft Fabric environment where data from major systems is automatically collected, validated, standardized, and exposed through trusted datasets.
• Reduce manual work by replacing analyst-led extraction and cleaning with centralized datasets that include clearly defined metrics and lineage.
• Design the platform so additional sources, analytics use cases, automation, and AI capabilities can be added over time without rebuilding the underlying infrastructure.