Director, AI Engineer - Data ML Platform
Manager
Ai Ml
Artificial Intelligence
Cloud Platforms
Data Analysis
Data Engineer
Data Platform
Data Processing
Data Science
Database
Databases
Director
Generative AI
Generative Ai Engineering
Information Technology (IT)
Large Language Models
Machine Learning
Programming
Software Development
Vector Databases
Job Description
Capital One is hiring a Director of AI Engineering to lead the engineering behind data and ML platform capabilities.
Responsibilities
- Partner with cross-functional teams including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One
- Oversee end-to-end delivery for AI software components: design, development, testing, deployment, and support across foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Make high-judgment build versus buy decisions across a broad stack of AI technologies and services, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related tooling
- Introduce state-of-the-art foundation model optimization techniques to improve performance for large scale production systems, including scalability, cost, latency, and throughput
- Shape the technical vision and long term roadmap for foundational AI systems at Capital One
- Attract and retain top AI talent; nurture personal and professional growth for the team and foster a culture focused on learning and staying current with state-of-the-art AI
- Translate enterprise AI strategy into portfolio-level execution plans across multiple product areas, balancing innovation with delivery discipline
- Scale AI engineering practices across teams using shared infrastructure, reusable components, and unified observability and governance frameworks
- Establish enterprise standards for Responsible AI, including fairness metrics, model evaluation protocols, documentation requirements, and audit readiness
- Partner with research, compliance, and enterprise risk teams to support ethical and regulatory expectations for deployed systems
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a Master's degree in the same areas plus at least 6 years of experience
- At least 3 years of people leadership experience
Technologies
- AWS Ultraclusters
- Huggingface
- VectorDBs
- PyTorch
- Python
- C++
- C#
- Java
- CUDA
- Golang
- AWS
- Google Cloud
- Azure
Team Description
- The Intelligent Foundations and Experiences (IFX) team brings Capital One's AI vision to life
- Builds and deploys proprietary solutions in collaboration with partners across the company to advance science and AI engineering
- Enables teams across Capital One to enhance products with AI at scale
- Focus areas include turning data into model-ready representations so scientists can test data hypotheses in days instead of months
Ideal Candidate
- Thrives when embedded with science and research teams, shaping experiments early and converting research ideas into data systems quickly
- Designs reliable, reproducible, versioned infrastructure so experiments can be traced to the exact data used
- Leads engineers with a high leverage mindset, identifying investments that speed up the research loop
- Builds with quality and shares a passion for doing the right thing; interested in problems that help change banking
- Stays current with research and applies novel techniques judiciously in production
- Empowers others through mentoring and coaching; hands-on when needed and leads by example
- Adapts quickly to big, undefined problems; digs into root causes and communicates findings clearly
- Demonstrates deep technical strength across hardware, software, and AI to find optimization opportunities
- Can forge new paths to achieve business goals when the route is unknown
Preferred Qualifications
- 5+ years of experience managing and leading an engineering team
- 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
- Experience developing AI and ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang
- Experience building agentic AI systems and agentic workflows
- Excellent communication and presentation skills for articulating complex AI concepts
- Experience delivering multiple enterprise products or capabilities concurrently across multi-team AI orgs
- Proven ability to expand and execute long-term AI platform strategies aligned to enterprise priorities and regulatory frameworks
- Experience establishing cross-functional operating rhythms and review cadences (OKRs, AI governance councils, quarterly reviews)
- Ability to right-size models, instance counts, and hardware types based on requirements (e.g., context length, token inputs, token outputs)
Benefits
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being
- Performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
- Eligibility varies based on full or part-time status, exempt or non-exempt status, and management level
Hybrid location: San Francisco, CA (hybrid). Expected to follow Capital One's hybrid policy for required on-site presence at the designated office location.
- Capital One may consider sponsoring a new qualified applicant for employment authorization for this position
- Applications expected to be accepted for at least 5 business days
- No agencies please
- Capital One is an equal opportunity employer (EOE, including disability/vet) and promotes a drug-free workplace
- Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site