Build responsible GenAI platform services that help teams across Capital One deliver high-impact AI in scalable, production-ready ways. Capital One’s Intelligent Foundations and Experiences (IFX) team brings the company’s vision for AI to life by advancing state-of-the-art science and engineering, while deploying proprietary solutions used by millions of customers. You will work with engineers, research scientists, technical program managers, and product managers to design, develop, deploy, and optimize AI software components and governance for agentic AI, guardrails, and evaluation.

Location: McLean, VA (onsite)
Compensation: USD 229,900 - 262,400 per year

What you’ll do

Partner cross-functionally to deliver AI-powered products that change how associates work and how customers interact with Capital One.
Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Use a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
Introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
Design and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models into unified systems.
Establish and lead cost-performance governance reviews across AI systems, including GPU utilization, model throughput, and inference cost efficiency.
Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.
Mentor Principal and Manager-level AI engineers to strengthen cross-domain learning and raise organizational technical maturity.

What we’re looking for

Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, plus at least 4 years of experience developing AI and ML algorithms or technologies. (Or Bachelor’s degree plus at least 6 years of experience.)
At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.

Helpful experience

Leading development of AI systems with tradeoff decisions around cost, latency, throughput, and accuracy.
7+ years deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
Designing, developing, delivering, and supporting complex AI systems.
Developing AI and ML algorithms using Python, C++, C#, Java, CUDA, or Golang, including LLM inference, similarity search and VectorDBs, guardrails, and memory.
Optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
Building agentic AI systems and agentic workflows.
Integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components into unified production pipelines.
Defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes.
Balancing model performance and operational cost through dynamic inference strategies and model compression.
Right-sizing models, instance counts, and hardware types given requirements such as context length and token inputs/outputs.

Skills and tools you may use

Python, Go, Scala, CUDA, Java, C++, C#, Golang
AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
LLM inference, similarity search, guardrails, memory
AWS, Google Cloud, Azure

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.

Incentives and other details

Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
This role is expected to accept applications for a minimum of 5 business days.
No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination.
Capital One promotes a drug-free workplace.

Accommodation and recruiting contact

If you require an accommodation to apply, contact Capital One Recruiting at 1-800-304-9102 or [email protected]. For technical support or questions about the recruiting process, email [email protected].

AI Engineer 5 (Gen AI Platform Services: Agentic AI, Guardrails, Evaluation)

Job Description