Build and support AI-powered products and foundational AI systems that improve how associates work and how customers interact with Capital One.

Work with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Use a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
Develop state-of-the-art foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
Shape the technical vision and long-term roadmap for foundational AI systems.
Design, implement, and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency.
Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.
Mentor Principal and Manager-level AI engineers to drive cross-domain learning and improve organizational technical maturity.

Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies; or Master’s degree plus at least 4 years of experience developing AI and ML algorithms or technologies.
At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.

Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields

Comprehensive, competitive, and inclusive health, financial, and other benefits to support total well-being
Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life.
Collaborates across the company to advance state of the art in science and AI engineering.
Builds and deploys proprietary solutions central to the business and value delivered to millions of customers.
Enables teams across Capital One to enhance products with responsible and scalable AI.

Experience leading development AI systems with tradeoff decisions across cost, latency, throughput, and accuracy
7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
Experience designing, developing, delivering, and supporting complex AI systems
Experience developing and applying AI and ML algorithms, including LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang
Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
Experience building agentic AI systems and agentic workflows
Passion for staying current with AI research and applying novel techniques in production
Excellent communication and presentation skills for explaining complex AI concepts to peers
Experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components, into unified production pipelines
Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes
Ability to balance model performance and operational cost using dynamic inference strategies and model compression
Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs

Salary ranges vary by location for AI Engineer 5, including McLean, VA ($229,900 - $262,400), Cambridge, MA ($229,900 - $262,400), New York, NY ($250,800 - $286,200), San Francisco, CA ($250,800 - $286,200), and San Jose, CA ($250,800 - $286,200).

AI Engineer 5 (MLX, Agentic AI, Gen AI platform Services)

Job Description