Sr. AI & Data Engineer
Senior
Ai Engineer
Artificial Intelligence
Azure Analytics
Azure Data Engineer
Azure Data Lake
Azure Solutions Architect
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Cloud Platforms
Data
Data & Ai
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Director
Data Engineering Lead
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Science Ops
Data Warehouse
Database
Databases
Databricks
Databricks Genie
Databricks Lakehouse
Databricks Pyspark
Databricks Workflows
Engineer
ETL
Gen Ai Engineering
Generative AI
Generative Ai Engineer
Informatica
Information Technology (IT)
Integration
Programming
Programming Language
Programming Languages
Spark
SQL
Job Description
Accenture is hiring a Sr. AI & Data Engineer in Irving, TX for a hybrid role with three days per week in the office at specified hiring locations. This position focuses on hands-on engineering across Azure data services and Databricks, with a strong emphasis on scalable data pipelines and autonomous agent capabilities.
In this role, you will design and optimize end-to-end data and AI workflows, partnering with data scientists and business analysts to deliver curated, validated datasets for analytics and AI initiatives. You will also be responsible for building retrieval and orchestration-driven AI agents and monitoring data pipeline health to support reliable, low-latency performance.
Responsibilities
- Architect, develop, and maintain scalable, low-latency data pipelines for ingesting and transforming diverse datasets using Azure Databricks workflows and Apache Spark.
- Design and optimize Lakehouse architecture with Delta Lake tables using Bronze, Silver, and Gold layers for efficient, reliable, and governed storage.
- Collaborate with data scientists and business analysts to produce clean, validated, well-modeled datasets for advanced analytics and AI initiatives.
- Design and implement autonomous agents using Databricks Mosaic AI Agent Framework along with frameworks such as LangChain or AutoGen.
- Build and optimize vector search indexes using Databricks Vector Search to support accurate context retrieval.
- Process large-scale distributed datasets on the Databricks Intelligence Platform with Apache Spark.
- Design and implement data models that address business requirements and improve data usability.
- Continuously evaluate and improve data architecture processes to enhance efficiency and effectiveness.
- Design AI agents with retrieval, orchestration, tool invocation, evaluation harnesses, and lifecycle observability.
- Continuously monitor pipeline health and performance, implementing automated alerting and observability frameworks for rapid troubleshooting and proactive optimization.
Requirements
- Minimum of 3 years of professional experience as a Data & AI Engineer or in a related role.
- Minimum of 3 years working with Microsoft Azure cloud data services.
- Minimum of 2 years with Databricks (PySpark, SQL, Delta Lake, workflows).
- Bachelor's degree or equivalent (minimum 12 years work experience). If an Associate Degree is held, a minimum of 6 years work experience is required.
Technologies
- Databricks; Azure data services; Azure Databricks; Spark; Apache Spark
- Databricks Mosaic AI Agent Framework; LangChain; AutoGen
- Delta Lake; Bronze, Silver, and Gold layers (Lakehouse Medallion Architecture)
- Databricks Vector Search
- Databricks Intelligence Platform; PySpark; SQL
- Git-based version control; CI/CD pipelines; Azure DevOps; GitHub Actions
- Auto Loader; MLOps / LLMOps
- Genie product family
- Databricks Certified Data Engineer Professional (2025); Microsoft Certified: Azure Data Engineer Associate
Benefits
- Medical, dental, vision, life, and long-term disability coverage
- 401(k) plan
- Bonus opportunities
- Paid holidays
- Paid time off
Similar Jobs
S
