Senior Staff AI Engineer (Sr. Director, IC) - Analysis Platform
Manager
Senior
Ai Ml
Artificial Intelligence
Cuda
Data & Ai
Data Analysis
Data Platform
Data Processing
Data Science
Deep Learning
Engineer
Generative AI
Generative Ai Engineering
Information Technology (IT)
Large Language Models
Machine Learning
Machine Learning Engineer
Programming
Programming Language
Programming Languages
Software Development
Job Description
Capital One is seeking a Senior Staff AI Engineer (Sr. Director, IC) to support the Analysis Platform within the Intelligent Foundations and Experiences (IFX) team. The role blends applied science and platform engineering to verify and improve open-ended analytical reasoning, with an emphasis on evaluation, agent workflows, and scalable AI infrastructure.
Role Overview
This position focuses on addressing an enterprise AI bottleneck: verifying and improving open-ended analytical reasoning. You will design benchmarks and automated systems that learn from production feedback, while establishing scalable architectural patterns for multi-step data synthesis.
Responsibilities
- Partner with cross-functional teams including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
- Operate at the intersection of Applied Science and Platform Engineering to solve enterprise verification and improvement of open-ended analytical reasoning.
- Design rigorous ground-truth benchmarks, build automated self-improving systems using production feedback, and establish scalable architectural patterns for multi-step data synthesis.
- Develop and deploy AI software components across foundation model training, LLM inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
- Introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for production AI systems.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Define and guide the technical AI architecture vision, translating applied research breakthroughs into production ecosystems with reliability and scale.
- Lead establishment of company-wide standards for AI performance, safety, and transparency.
- Drive multi-year platform initiatives unifying data, compute, and model lifecycle management under an integrated enterprise AI architecture.
- Mentor senior technical leaders across research, data, and engineering disciplines to develop Capital One’s next generation of AI technical leadership.
Team Description
- The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life.
- IFX builds and deploys proprietary solutions central to the business and delivering value to millions of customers.
- The team is reimagining business decision-making by moving beyond static dashboards and manual data pulls to autonomous, reasoning-driven analytical workflows.
Required Qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 8 years of such experience.
- At least 10 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technology Stack
- Python, Go, Scala, CUDA, Java
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- Large language model inference, LLM chains
- Similarity search, guardrails, model evaluation, experimentation, governance, observability
Preferred Qualifications
- Experience architecting AI platforms with tradeoffs around cost, latency, throughput, and accuracy.
- 9+ years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
- Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- Demonstrated ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the SVP level.
- Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang.
- Experience applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and agentic workflows.
- Ability to stay current with AI research and apply novel techniques judiciously in production.
- Excellent communication and presentation skills, including explaining complex AI concepts to peers.
- Recognized industry leader in applied AI or machine learning infrastructure through patents, publications, or open-source leadership.
- Experience designing long-term AI infrastructure strategies balancing cost, scale, ethics, and regulatory compliance.
- Experience driving organization-wide adoption of AI safety, alignment, and governance standards in collaboration with policy, risk, and legal teams.
- Proven ability to shape R&D investment strategy by identifying breakthrough AI capabilities with material business impact.
- Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs.
Compensation and Incentives
- San Jose, CA: USD 343,400 - 392,000 per year for Senior Staff AI Engineer.
- This role may also be eligible for performance-based incentive compensation, which could include cash bonus(es) and/or long-term incentives (LTI). Incentives may be discretionary or non-discretionary depending on the plan.
Additional Information
- Location: San Jose, CA (hybrid)
- Hybrid requirement: Must adhere to Capital One’s hybrid policy regarding required on-site presence at the designated office location.
- Application timeline: Expected to accept applications for a minimum of 5 business days.
- Equal opportunity: Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
- Workplace policies: Capital One promotes a drug-free workplace.
- Agencies: No agencies please.
- Accommodation and support: For accommodations, contact Capital One Recruiting at 1-800-304-9102 or [email protected]. For technical support or questions about the recruiting process, email [email protected].
- Additional disclosures: Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
- Entity note: Capital One Financial consists of several entities; postings in Canada, the United Kingdom, and the Philippines map to corresponding entities.