Eli Lilly is building governed, auditable data capabilities for covered entity (CE) pharmacy operations on the Databricks platform. In this onsite role in Indianapolis, IN, you’ll help operationalize the LillyDirect Covered Entity (CE) Pharmacy data platform by designing production pipelines that enforce PHI isolation, identity crosswalk rules, and data contracts as code.
You’ll work in a platform-focused environment where security controls, lineage, and quality requirements are implemented inside the pipelines and access layers, so CE data products can be consumed confidently by downstream CE Skills and agents.
What you’ll do
- Design and build scalable Databricks pipelines implementing the CE Architect’s canonical data models across medallion layers (bronze → silver → gold) within the CE trust boundary.
- Select and apply Databricks and integration patterns including Unity Catalog, Delta Lake, Databricks Workflows, serverless compute, Lakebase, and ingestion connectors to balance performance, cost, and scalability.
- Implement the identity crosswalk and PHI classification logic defined by the CE Architect using systems such as Reltio MDM, Auth0/Passport, Datavant tokens, Scriptly, Genesys, Prescryptive, and Transcend, with safeguards for merge/split integrity.
- Deliver ODCS data contracts by enforcing schema, quality, freshness/SLA, and lineage requirements directly in pipeline logic (not just documentation).
- Implement row/column-level security, masking, and tokenization boundaries so PHI isolation is enforced at the platform layer, in partnership with the Policy-as-Code Engineer’s OPA/Rego policies.
- Own the end-to-end pipeline lifecycle from prototyping through production deployment and maintenance for CE data products, collaborating with Analytics Engineers and the DataHub Product Owner.
- Build and maintain CI/CD pipelines using GitHub Actions and Git-based promotion (dev → test → prod) for CE data, contract, policy, and agent artifacts.
- Automate data ingestion and product creation to reduce manual pipeline maintenance and onboarding time for new CE data sources.
- Partner with the CE Data Architect on reference architecture and patterns, providing implementation feedback to keep designs buildable and performant at scale.
- Support governed consumption paths by building pipelines that let CE Skills and agents use the data while ensuring PHI classification and consent travel into agentic consumption paths.
What you’ll bring
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a similar field.
- Experience in data engineering, focused on building production data pipelines and data products.
- Advanced SQL and Python, with hands-on Databricks / Unity Catalog fluency (notebooks, Delta Lake, catalog/schema/grants, Workflows).
- Qualified applicants must be authorized to work in the United States on a full-time basis. Lilly will not provide support for or sponsor work authorization or visas for this role.
Compensation
$63,000 - $149,600 per year
Benefits
- Company bonus (depending, in part, on company and individual performance)
- Eligibility to participate in a company-sponsored 401(k)
- Pension
- Vacation benefits
- Eligibility for medical, dental, vision, and prescription drug benefits
- Flexible benefits (for example, healthcare and/or dependent day care flexible spending accounts)
- Life insurance and death benefits
- Certain time off and leave of absence benefits
- Well-being benefits (for example, employee assistance program, fitness benefits, and employee clubs and activities)
Tools you may use
Databricks, Unity Catalog, Delta Lake, Databricks Workflows, serverless compute, Lakebase, ingestion connectors, Reltio MDM, Auth0, Passport, Datavant tokens, Scriptly, Genesys, Prescryptive, Transcend, ODCS, OPA/Rego, GitHub Actions, Git, Python, SQL, RBAC, ABAC, row- and column-level security, tokenization, masking, CI/CD, PySpark, DLT, pytest, DQX, Great Expectations, Terraform, identity resolution, Jira, Agile/Scrum, HIPAA, PHI, tokenization/de-identification, AI Skills, agents.
