Sr. Director, AI Engineer
Job Description
Capital One is hiring a Sr. Director, AI Engineer (McLean, VA, remote) to architect responsible, reliable AI systems and lead a unified personalization engine for agent-led experiences.
Responsibilities
- Architect a unified, low-latency personalization engine to model user intent, preferences, and constraints across multiple product verticals while protecting privacy and preventing context leakage.
- Define representation, governance, and real-time injection of long-horizon user state into agentic planning loops, with proactive autonomy for exploratory tasks and strict determinism and trust guardrails for financial workflows.
- Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One.
- Oversee end-to-end delivery of AI software components: foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability (plus additional components as needed).
- Make high-judgment build-vs-buy decisions across open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
- Contribute to technical vision and the long-term roadmap for foundational AI systems at Capital One.
- Attract and retain AI talent; nurture team development through learning, coaching, and staying current with state-of-the-art AI.
- Drive enterprise-wide AI strategy and align product, research, risk, and data organizations around shared technical and ethical principles.
- Establish a multi-year roadmap for scalable, reliable, and compliant AI systems to serve as shared enterprise infrastructure.
- Champion Responsible-AI by embedding ethical, transparent, and explainable model practices across lines of business.
- Oversee scaling of AI operations across hundreds of production use cases, including model lifecycle management, observability, and cost efficiency.
Requirements
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years developing AI and ML algorithms or technologies, or a Master’s degree in a related field plus at least 8 years developing AI and ML algorithms or technologies.
- At least 5 years of people leadership experience.
Team Description
- The Intelligent Foundations and Experiences (IFX) team builds Capital One’s AI vision.
- As the ecosystem shifts toward agent-led experiences, personalization becomes a dynamic, stateful memory and context layer, not a simple ranking model.
- The team builds the core personalization service that tailors agentic behavior across different surfaces, from high-discovery workflows (for example, travel booking) to high-precision tasks (for example, paying bills with minimal margin for error).
Ideal Candidate
- Expertise in context management, recommendation systems, or identity infrastructure, with experience evolving these concepts for the agentic era.
- Strong understanding of the difference between predicting user preferences and executing user intent safely.
- Background building high-throughput systems, stateful memory architectures, and advanced RAG pipelines with strict data partitioning.
- Ability to define unified APIs, align stakeholders around system boundaries, and design for graceful degradation and absolute user trust.
- Ability to interpret AI research and apply novel techniques judiciously in production.
- Motivation to empower others through mentoring and coaching; hands-on leadership and leading by example.
- Comfort tackling big, undefined problems with clarity; ability to share new ideas even when unproven.
- Deep technical foundation in engineering and mathematics, with experience across hardware, software, and AI to identify optimization opportunities.
- Resilient trailblazer mindset to forge new paths when routes are unknown.
Preferred Qualifications
- 7+ years of experience managing and leading an engineering team.
- 8+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience developing AI/ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
- Experience building agentic AI systems and agentic workflows.
- Ability to articulate complex AI concepts with excellent communication and presentation skills.
- Demonstrated experience leading leaders and multiple AI engineering organizations across product, platform, and applied research domains.
- Proven success building enterprise-scale AI platforms and capabilities for diverse business lines and customer use cases.
- Ability to influence executive leadership on AI investment strategy, organizational design, and risk management priorities.
- Experience establishing external partnerships or thought leadership in AI, academia, or open-source communities.
- Experience right-sizing models, instance counts, and hardware types based on requirements (such as context length, token inputs, and token outputs).
Technologies
- AWS Ultraclusters
- Huggingface
- VectorDBs
- PyTorch
- Python
- C++
- C#
- Java
- CUDA
- Golang
- AWS
- Google Cloud
- Azure
Location and Compensation
- Remote (regardless of location): $286,200 - $326,700
- Cambridge, MA: $314,800 - $359,300
- McLean, VA: $314,800 - $359,300
- New York, NY: $343,400 - $392,000
- San Francisco, CA: $343,400 - $392,000
- San Jose, CA: $343,400 - $392,000
- Performance-based incentive compensation may include cash bonus(es) and/or long-term incentives (LTI).
- Incentives could be discretionary or non-discretionary depending on the plan.