AI Engineer 5 (AI Foundations: Evaluations and Agentic Workflows)
Job Description
Capital One is hiring an AI Engineer 5 to support the Intelligent Foundations and Experiences (IFX) team. The role builds and evaluates responsible, reliable AI systems, spanning foundation model training and inference, agentic workflows, and orchestration pipelines, with a focus on governance and observability.
Key Responsibilities
- Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered capabilities that improve how associates work and how customers engage with Capital One.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Apply a technology stack that may include AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch, along with other Open Source and SaaS AI tools.
- Develop state-of-the-art foundation model optimization methods to improve production performance, including scalability, cost, latency, and throughput.
- Contribute to the technical vision and long-term roadmap for foundational AI systems within Capital One.
- Design, implement, and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models into unified systems.
- Establish and lead cost-performance governance reviews across AI systems, including tracking GPU utilization, model throughput, and inference cost efficiency.
- Participate in team design councils or design review boards to maintain technical consistency and compliance with AI engineering standards.
- Mentor Principal and Manager-level AI engineers, supporting cross-domain learning and increasing organizational technical maturity.
Required Qualifications
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in a related field plus at least 4 years of experience developing AI and ML algorithms or technologies.
- At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- LLMs, vector search, Retrieval-augmented, rule-based
Team Overview
The Intelligent Foundations and Experiences (IFX) team brings Capital One's AI vision to life. The team works closely with partners across the organization to advance science and AI engineering, and to build and deploy proprietary solutions that deliver value to millions of customers. AI models and platforms support teams across Capital One in enhancing products with responsible, scalable AI for high-leverage impact.
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits to support total well-being (eligibility varies).
Ideal Candidate Profile
- Enjoys building systems and takes pride in delivering high-quality work while maintaining a focus on responsible outcomes.
- Stays current with AI research and can translate scientific publications into practical production techniques.
- Adapts quickly to bring clarity to large, undefined problems.
- Asks questions, digs into root causes, and communicates findings clearly and concisely.
- Shares new ideas even when they are unproven.
- Works from a deeply technical foundation, including strong engineering and mathematics skills, with the ability to identify optimization opportunities across hardware, software, and AI.
- Demonstrates resilience and the ability to forge new paths when the route is not yet established to achieve business goals.
Preferred Qualifications
- Experience leading development of AI systems with tradeoff decisions across cost, latency, throughput, and accuracy.
- 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
- Experience designing, developing, delivering, and supporting complex AI systems.
- Experience developing AI and ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
- Experience applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and agentic workflows.
- Experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components, into unified production pipelines.
- Experience defining and enforcing ethical AI deployment standards, including explainability, fairness, and human-in-the-loop review processes.
- Experience balancing model performance and operational cost through dynamic inference strategies and model compression.
- Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs.
Hybrid Work and Authorization
This role is designated as hybrid. You are expected to follow Capital One's hybrid policy for required on-site presence at your designated office location.
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Salary, Location, and Incentives
- Location: New York, NY (hybrid)
- Salary range: USD 250,800 - 286,200 per yearly
Candidates hired for other locations will be subject to the pay range associated with that location, and the annualized salary offered will be reflected in the candidate’s offer letter.
This role may be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI). Incentives could be discretionary or non-discretionary depending on the plan.
Other Recruiting Details
- Expected application timeline: accepts applications for a minimum of 5 business days.
- No agencies please.
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
- Capital One promotes a drug-free workplace.
- Capital One will consider qualified applicants with a criminal history in a manner consistent with applicable federal, state, and local laws regarding criminal background inquiries.
- Accommodation request: contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected] (confidential).
- Recruiting process questions or technical support: [email protected].
Additional Salary Ranges by Location
- Cambridge, MA: $229,900 - $262,400
- McLean, VA: $229,900 - $262,400
- New York, NY: $250,800 - $286,200
- San Francisco, CA: $250,800 - $286,200
- San Jose, CA: $250,800 - $286,200
Capital One does not provide, endorse, or guarantee and is not liable for third-party products, services, educational tools, or other information available through this site. Capital One Financial is made up of several different entities.