Data Engineer
Azure
Azure Data Factory
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Engineer
ETL
Informatica
Information Technology (IT)
Microsoft Azure
Programming Language
Programming Languages
SQL
Job Description
Work on enterprise data integration and scalable data platforms, building reliable data warehouses on Microsoft SQL Server and Azure.
Responsibilities
- Lead data integration across Clinical/Healthcare Practice Management Systems, Electronic Medical Record (EMR) systems, HR, Accounting, CRM, and other enterprise platforms
- Architect and oversee scalable data platforms and database architectures for multiple business lines
- Design and optimize complex ETL/ELT pipelines using Azure Data Factory, other Azure services, and Python, focused on reliability and performance
- Orchestrate pipelines that use AI/LLMs for data extraction from documents and diverse sources
- Drive enterprise data initiatives, including capturing required data and building sustainable, enterprise-grade databases
- Perform advanced data profiling, cleansing, and transformation to support analytics and reporting teams
- Implement Master Data Management (MDM) strategies to maintain data consistency and integrity
- Identify process improvement opportunities and spearhead automation to reduce delivery time and improve quality
- Establish and maintain data lineage, monitoring, and operational tracking systems
- Provide hands-on support, mentor junior engineers, and support a culture of knowledge sharing and continuous improvement
- Partner with stakeholders to gather evolving data requirements and translate them into scalable technical solutions
- Maintain high code quality via documentation, source control, code reviews, and rigorous testing practices
- Identify integration gaps, recommend solutions, and drive continuous improvement in data processes
- Define and enforce team best practices for data engineering and integration
- Evaluate emerging Azure capabilities and lead proofs of concept to confirm fit for purpose
Requirements
- 7+ years of experience in database and ETL development roles
- 4+ years of deep hands-on experience with Azure Data Factory (ADF)
- 3+ years experience with healthcare and/or financial data or other highly regulated verticals
- 2+ years experience using Python
- Strong working knowledge of the Azure ecosystem tools
- Advanced proficiency in T-SQL and SQL Server
- Strong grasp of data modeling, indexing, and schema design principles
- Proven ability to manage multiple priorities and drive solutions from conception through production
- Effective collaboration and communication across stakeholders
- Bachelor's degree or higher
Technologies
- Microsoft SQL Server
- Azure
- Azure Data Factory (ADF)
- Python
- T-SQL
- AI/LLMs
- Other Azure services
Preferred Experience
- Experience with healthcare EDI file data integration (examples: 835, 837)
- Experience extracting data from documents using AI/LLMs
Location: Addison, TX 75001 (hybrid)
Similar Jobs
S