AI Engineer 4 (MLX, Agentic AI, Gen AI platform Services)

Capital One is hiring an AI Engineer 4 for the Intelligent Foundations and Experiences (IFX) team in San Jose, CA (onsite). In this role, you will help build and deploy responsible, scalable AI platform services, spanning foundation model training through LLM inference and agentic workflows.

Working with a cross-functional group of engineers and research leaders, you will design end-to-end AI system components with an emphasis on evaluation and governance, observability, and optimization for performance and cost in production environments.

What you’ll do

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered capabilities that improve how associates work and how customers engage with Capital One.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Build using a stack of open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related tools.
• Introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
• Own end-to-end architecture for complex AI systems, focusing on maintainability, observability, and ethical alignment.
• Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
• Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
• Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
• Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.

Minimum qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 4 years of experience developing AI/ML algorithms or technologies, or Master’s degree plus at least 2 years of experience developing AI/ML algorithms or technologies.
• At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• AWS, Google Cloud, Azure
• Python, Go, Scala, CUDA, Java, C++, C#, Golang
• GPU, TPU

Preferred qualifications

• Experience leading development of AI systems with tradeoffs across cost, latency, throughput, and accuracy.
• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, delivering, and supporting AI services.
• Experience developing AI/ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
• Experience applying state-of-the-art techniques to optimize training and inference software for better hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and agentic workflows.
• Passion for staying current with AI research and applying new techniques in production.
• Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale.
• Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules.
• Ability to influence architectural decisions across multiple AI product lines or platforms.

Team context

• The Intelligent Foundations and Experiences (IFX) team is central to bringing Capital One’s AI vision to life.
• Team members work with partners across the company to advance the state of the art in science and AI engineering, while building and deploying proprietary solutions.
• AI models and platforms developed by IFX enable teams across Capital One to enhance products with responsible, scalable AI for high-leverage impact.

Compensation and benefits

• Salary (San Jose, CA): USD 215,200 to 245,600 per year.
• Performance-based incentive compensation may include cash bonus(es) and/or long term incentives (LTI).
• Comprehensive, competitive, and inclusive set of health, financial, and other benefits.

Additional notes

• Capital One may consider sponsoring a new qualified applicant for employment authorization for this position.
• This role is expected to accept applications for a minimum of 5 business days.