DataJobs.io
← Back to all jobs

Job Description

Hybrid (Tuesday–Thursday onsite from Day 1) in Cary, NC, with a flexible schedule. This hands-on Lead Data Engineer / Architect role combines enterprise data platform work with production AI/LLM implementation, including LLM, RAG, embeddings, retrieval, and prompt engineering.

In this position at Fasiokart, you will design and build production-grade data solutions, guide data engineering teams through code review and technical direction, and help implement an enterprise lakehouse/medallion architecture using Bronze, Silver, and Gold layers.

What you’ll do

  • Design solutions, write production code, review code, and provide technical guidance to data engineering teams.
  • Hands-on design and deployment of LLM-based solutions, including RAG, embeddings, retrieval, and prompt engineering.
  • Design and implement an enterprise lakehouse / medallion architecture with Bronze, Silver, and Gold layers.

Core responsibilities

  • Build production AI and data capabilities that include MLOps/LLMOps, model evaluation, and production AI monitoring.
  • Deliver data pipeline engineering with metadata-driven ingestion, data transformation, data quality, and large-scale pipeline optimization.
  • Support AI-driven initiatives such as data quality, anomaly detection, and automated reconciliation.
  • Contribute to enterprise semantic capabilities such as knowledge graphs, ontologies, semantic layers, or Text-to-SQL.
  • Work with Azure governance and security practices including PII protection and fine-grained access controls.
  • Automate data pipeline deployments using Azure DevOps and CI-CD, with Terraform and Databricks Asset Bundles highly relevant.

What you bring

  • 12+ years of relevant experience.
  • Strong production-level data engineering skills in Python, PySpark, Scala, and SQL.
  • Deep experience with Azure Databricks including Delta Lake, Spark performance tuning, Jobs/Workflows, and Unity Catalog.
  • Hands-on experience with Azure Data Factory (ADF) and ADLS Gen2.
  • Proven experience implementing Bronze, Silver, and Gold lakehouse layers at enterprise scale.
  • Hands-on production AI/LLM experience implementing LLM/RAG including embeddings, retrieval, and prompt engineering.
  • Experience with LLM frameworks such as LangChain, LlamaIndex, or LangGraph, plus Azure OpenAI, OpenAI, or Databricks Model Serving.
  • Experience automating deployments and pipeline delivery using Azure DevOps and CI-CD, with Terraform and Databricks Asset Bundles highly relevant.
  • Domain knowledge in financial services or insurance data, especially financial reconciliation, general ledger, or accounting data.
  • Knowledge of Azure security and data governance, including PII protection and fine-grained access controls.
  • Evidence of recent production coding experience, as this is not a purely managerial or coordination role.
  • Willing and able to work onsite in Cary, NC from Day 1, Tuesday–Thursday.

Additional details

  • Employment type: Full-time
  • Location: Cary, NC (hybrid)
  • Pay: $145,000–$160,000 per year
  • Work model: Day 1 onsite; hybrid schedule with Tuesday–Thursday onsite

Technologies you’ll work with

Python, PySpark, Scala, SQL, Azure Databricks, Delta Lake, Jobs/Workflows, Unity Catalog, Azure Data Factory (ADF), ADLS Gen2, lakehouse/medallion architecture, LangChain, LlamaIndex, LangGraph, Azure OpenAI, OpenAI, Databricks Model Serving, Azure DevOps, CI-CD, Terraform, Databricks Asset Bundles, Text-to-SQL, MLOps/LLMOps.

Candidate priorities

  • Highest priority: Azure Databricks + enterprise data engineering expertise combined with production LLM/RAG implementation experience.
  • Secondary priority: Strong data platform engineering and production AI experience, plus insurance/financial services domain knowledge and governance expertise.
  • Not prioritized: Pure people managers, candidates without hands-on production AI/LLM experience, candidates lacking core Azure Databricks expertise, or candidates unable to meet mandatory onsite and compensation requirements.

Similar Jobs