Principal Data Engineer
Big Data
Bigdata
Clinical Data
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Operations
Cloud Platform
Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Integration Tools
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Data Warehousing
Database
Databases
Databricks
Engineer
ETL
Informatica
Information Technology (IT)
Integration
Lead Data Engineering
Principal Data Analyst
Programming
Programming Language
Programming Languages
Project Management
Snowflake
Software Development
Spark
SQL
Job Description
Abbott Laboratories is hiring a Principal Data Engineer to lead cross-domain enterprise data engineering initiatives at a senior individual contributor level. This onsite role in Madison, WI focuses on hands-on technical leadership across architecture, standards, delivery, validation, and production lifecycle support, with no people-management responsibility.
Role scope
- Own the technical outcome of assigned cross-domain initiatives from early ambiguity through production and lifecycle support.
- Translate enterprise needs into integrated architecture and executable plans, decomposing complex work into deliverable increments across domains.
- Coordinate technical execution across domain Staff Engineers and partner teams, surfacing dependencies and architectural risks and escalating decisions requiring business or delivery authority.
- Remain hands-on across prototypes, reference implementations, critical-path development, technical validation, and production problem solving.
Architecture, standards, and governed data
- Define, steward, and evolve enterprise data engineering standards, patterns, and reference architectures; drive convergence where inconsistent or duplicative implementations increase enterprise cost, risk, or operational burden.
- Lead architecture for enterprise capabilities including semantic and metrics layers, canonical data models, and batch, API, event-driven, and streaming patterns.
- Develop enterprise data-contract standards covering schemas, service expectations, compatibility, breaking-change policy, and producer-consumer responsibilities.
- Partner with Platform Engineering to convert recurring cross-domain needs into shared capabilities.
Reviews, escalation, and compliance
- Lead enterprise design and code reviews for high-complexity or cross-domain work, and coach and mentor Staff and Senior Engineers across domains through influence without formal people authority.
- Communicate architecture and tradeoffs clearly to engineering, business, and executive stakeholders, and build reusable guidance to improve consistency across Enterprise Data.
- Evaluate architecture tradeoffs across reliability, scalability, performance, security, privacy, operability, adoption, and technical cost; drive cost-efficient use of compute, storage, streaming, and orchestration.
- Act as an enterprise technical escalation for incidents involving multiple domains or shared architecture patterns; lead root-cause analysis and preventive changes for recurring enterprise issues.
- Design and review architectures that handle protected health information to meet applicable security, privacy, lineage, audit, Quality Management System, HIPAA, CLIA, and regulatory requirements.
Vendor solutions and responsible engineering
- Provide technical direction and due diligence for vendor and external-partner solutions.
- Advance responsible engineering practices, including approved AI-assisted development capabilities.
Additional expectations
- Ability to work nights and/or weekends, as needed.
- Uphold Abbott mission and values through accountability, innovation, integrity, quality, and teamwork.
- Support and comply with the company Quality Management System policies and procedures.
- Maintain regular and reliable attendance.
- Act with an inclusion mindset and model these behaviors for the organization.
Requirements
- Bachelor’s Degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering; or High School Diploma/General Education Degree and 12 years of relevant experience in the essential duties in lieu of a Bachelor’s.
- Expert-level experience with software development design and development, plus relevant domain-specific skills.
- Spark on Databricks or comparable platforms; Python, Scala, SQL, and Snowflake experience.
- ETL and ELT data pipelines, including batch and event-driven patterns.
- Designing and implementing data modeling solutions using relational, dimensional, and/or NoSQL databases.
- Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.
- Open data file and table formats including Parquet, Avro, and Delta Lake; cloud infrastructure and delivery services including AWS, S3, SQS, and GitLab CI/CD.
- REST API development; familiarity with BI concepts and Tableau performance considerations.
- Agile development tools including JIRA, Confluence, and repository usage.
- Ability to lead through influence across multiple teams and communicate complex technical decisions to senior engineering, business, and executive stakeholders.
- Ability to perform essential duties with or without accommodation.
Preferred qualifications
- Databricks, Apache Spark, Delta Lake, and Unity Catalog at enterprise scale.
- Kafka, change data capture, and production event-streaming architectures.
- Semantic or metrics layer design, canonical data models, and governed data products.
- Cloud data architecture in AWS, Azure, or Google Cloud Platform.
- Life sciences, diagnostics, or clinical laboratory environments involving protected health information and requirements related to HIPAA, CLIA, FDA, or Quality Management System.
- Technical assessment and architecture direction for vendor and external-partner platforms.
Technologies
- Databricks, Unity Catalog, Spark, Python, Scala, SQL, Snowflake
- ETL, ELT, Parquet, Avro, Delta Lake
- AWS, S3, SQS, GitLab CI/CD
- REST API, Tableau, JIRA, Confluence
- HIPAA, CLIA
Compensation and location
- Location: Madison, WI (onsite)
- Base pay range: USD $129,300 - $258,700 per year