DataJobs.io
← Back to all jobs

Job Description

Abbott Laboratories is hiring a Principal Data Engineer to lead cross-domain enterprise data engineering initiatives at a senior individual contributor level. This onsite role in Madison, WI focuses on hands-on technical leadership across architecture, standards, delivery, validation, and production lifecycle support, with no people-management responsibility.

Role scope

  • Own the technical outcome of assigned cross-domain initiatives from early ambiguity through production and lifecycle support.
  • Translate enterprise needs into integrated architecture and executable plans, decomposing complex work into deliverable increments across domains.
  • Coordinate technical execution across domain Staff Engineers and partner teams, surfacing dependencies and architectural risks and escalating decisions requiring business or delivery authority.
  • Remain hands-on across prototypes, reference implementations, critical-path development, technical validation, and production problem solving.

Architecture, standards, and governed data

  • Define, steward, and evolve enterprise data engineering standards, patterns, and reference architectures; drive convergence where inconsistent or duplicative implementations increase enterprise cost, risk, or operational burden.
  • Lead architecture for enterprise capabilities including semantic and metrics layers, canonical data models, and batch, API, event-driven, and streaming patterns.
  • Develop enterprise data-contract standards covering schemas, service expectations, compatibility, breaking-change policy, and producer-consumer responsibilities.
  • Partner with Platform Engineering to convert recurring cross-domain needs into shared capabilities.

Reviews, escalation, and compliance

  • Lead enterprise design and code reviews for high-complexity or cross-domain work, and coach and mentor Staff and Senior Engineers across domains through influence without formal people authority.
  • Communicate architecture and tradeoffs clearly to engineering, business, and executive stakeholders, and build reusable guidance to improve consistency across Enterprise Data.
  • Evaluate architecture tradeoffs across reliability, scalability, performance, security, privacy, operability, adoption, and technical cost; drive cost-efficient use of compute, storage, streaming, and orchestration.
  • Act as an enterprise technical escalation for incidents involving multiple domains or shared architecture patterns; lead root-cause analysis and preventive changes for recurring enterprise issues.
  • Design and review architectures that handle protected health information to meet applicable security, privacy, lineage, audit, Quality Management System, HIPAA, CLIA, and regulatory requirements.

Vendor solutions and responsible engineering

  • Provide technical direction and due diligence for vendor and external-partner solutions.
  • Advance responsible engineering practices, including approved AI-assisted development capabilities.

Additional expectations

  • Ability to work nights and/or weekends, as needed.
  • Uphold Abbott mission and values through accountability, innovation, integrity, quality, and teamwork.
  • Support and comply with the company Quality Management System policies and procedures.
  • Maintain regular and reliable attendance.
  • Act with an inclusion mindset and model these behaviors for the organization.

Requirements

  • Bachelor’s Degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering; or High School Diploma/General Education Degree and 12 years of relevant experience in the essential duties in lieu of a Bachelor’s.
  • Expert-level experience with software development design and development, plus relevant domain-specific skills.
  • Spark on Databricks or comparable platforms; Python, Scala, SQL, and Snowflake experience.
  • ETL and ELT data pipelines, including batch and event-driven patterns.
  • Designing and implementing data modeling solutions using relational, dimensional, and/or NoSQL databases.
  • Database architecture testing methodology, including execution of test plans, debugging, and testing scripts and tools.
  • Open data file and table formats including Parquet, Avro, and Delta Lake; cloud infrastructure and delivery services including AWS, S3, SQS, and GitLab CI/CD.
  • REST API development; familiarity with BI concepts and Tableau performance considerations.
  • Agile development tools including JIRA, Confluence, and repository usage.
  • Ability to lead through influence across multiple teams and communicate complex technical decisions to senior engineering, business, and executive stakeholders.
  • Ability to perform essential duties with or without accommodation.

Preferred qualifications

  • Databricks, Apache Spark, Delta Lake, and Unity Catalog at enterprise scale.
  • Kafka, change data capture, and production event-streaming architectures.
  • Semantic or metrics layer design, canonical data models, and governed data products.
  • Cloud data architecture in AWS, Azure, or Google Cloud Platform.
  • Life sciences, diagnostics, or clinical laboratory environments involving protected health information and requirements related to HIPAA, CLIA, FDA, or Quality Management System.
  • Technical assessment and architecture direction for vendor and external-partner platforms.

Technologies

  • Databricks, Unity Catalog, Spark, Python, Scala, SQL, Snowflake
  • ETL, ELT, Parquet, Avro, Delta Lake
  • AWS, S3, SQS, GitLab CI/CD
  • REST API, Tableau, JIRA, Confluence
  • HIPAA, CLIA

Compensation and location

  • Location: Madison, WI (onsite)
  • Base pay range: USD $129,300 - $258,700 per year

Similar Jobs