Hybrid (Tuesday–Thursday onsite from Day 1) in Cary, NC, with a flexible schedule. This hands-on Lead Data Engineer / Architect role combines enterprise data platform work with production AI/LLM implementation, including LLM, RAG, embeddings, retrieval, and prompt engineering.
In this position at Fasiokart, you will design and build production-grade data solutions, guide data engineering teams through code review and technical direction, and help implement an enterprise lakehouse/medallion architecture using Bronze, Silver, and Gold layers.
What you’ll do
- Design solutions, write production code, review code, and provide technical guidance to data engineering teams.
- Hands-on design and deployment of LLM-based solutions, including RAG, embeddings, retrieval, and prompt engineering.
- Design and implement an enterprise lakehouse / medallion architecture with Bronze, Silver, and Gold layers.
Core responsibilities
- Build production AI and data capabilities that include MLOps/LLMOps, model evaluation, and production AI monitoring.
- Deliver data pipeline engineering with metadata-driven ingestion, data transformation, data quality, and large-scale pipeline optimization.
- Support AI-driven initiatives such as data quality, anomaly detection, and automated reconciliation.
- Contribute to enterprise semantic capabilities such as knowledge graphs, ontologies, semantic layers, or Text-to-SQL.
- Work with Azure governance and security practices including PII protection and fine-grained access controls.
- Automate data pipeline deployments using Azure DevOps and CI-CD, with Terraform and Databricks Asset Bundles highly relevant.
What you bring
- 12+ years of relevant experience.
- Strong production-level data engineering skills in Python, PySpark, Scala, and SQL.
- Deep experience with Azure Databricks including Delta Lake, Spark performance tuning, Jobs/Workflows, and Unity Catalog.
- Hands-on experience with Azure Data Factory (ADF) and ADLS Gen2.
- Proven experience implementing Bronze, Silver, and Gold lakehouse layers at enterprise scale.
- Hands-on production AI/LLM experience implementing LLM/RAG including embeddings, retrieval, and prompt engineering.
- Experience with LLM frameworks such as LangChain, LlamaIndex, or LangGraph, plus Azure OpenAI, OpenAI, or Databricks Model Serving.
- Experience automating deployments and pipeline delivery using Azure DevOps and CI-CD, with Terraform and Databricks Asset Bundles highly relevant.
- Domain knowledge in financial services or insurance data, especially financial reconciliation, general ledger, or accounting data.
- Knowledge of Azure security and data governance, including PII protection and fine-grained access controls.
- Evidence of recent production coding experience, as this is not a purely managerial or coordination role.
- Willing and able to work onsite in Cary, NC from Day 1, Tuesday–Thursday.
Additional details
- Employment type: Full-time
- Location: Cary, NC (hybrid)
- Pay: $145,000–$160,000 per year
- Work model: Day 1 onsite; hybrid schedule with Tuesday–Thursday onsite
Technologies you’ll work with
Python, PySpark, Scala, SQL, Azure Databricks, Delta Lake, Jobs/Workflows, Unity Catalog, Azure Data Factory (ADF), ADLS Gen2, lakehouse/medallion architecture, LangChain, LlamaIndex, LangGraph, Azure OpenAI, OpenAI, Databricks Model Serving, Azure DevOps, CI-CD, Terraform, Databricks Asset Bundles, Text-to-SQL, MLOps/LLMOps.
Candidate priorities
- Highest priority: Azure Databricks + enterprise data engineering expertise combined with production LLM/RAG implementation experience.
- Secondary priority: Strong data platform engineering and production AI experience, plus insurance/financial services domain knowledge and governance expertise.
- Not prioritized: Pure people managers, candidates without hands-on production AI/LLM experience, candidates lacking core Azure Databricks expertise, or candidates unable to meet mandatory onsite and compensation requirements.