AI Engineer 5 (AI Foundations: Evaluations and Agentic Workflows)
Job Description
Capital One’s Intelligent Foundations and Experiences (IFX) team is building the next generation of AI platforms that help power responsible, reliable production systems. In this AI Engineer 5 role, you will focus on evaluations and agentic workflows, including the engineering work needed to deliver scalable AI capabilities that support associates and customer experiences.
Role focus
- Build and optimize foundation model components for production AI, with an emphasis on responsible system behavior.
- Develop orchestration pipelines for agentic workflows and multi-model systems, integrating LLMs, vector search, and domain-specific models.
- Create evaluation, experimentation, governance, and observability capabilities to support scalable deployment.
Responsibilities
- Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products across Capital One.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Apply a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, and VectorDBs, alongside frameworks such as PyTorch.
- Introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
- Contribute to the technical vision and long term roadmap for foundational AI systems at Capital One.
- Design, implement, and optimize multi-model orchestration pipelines that unify LLMs, vector search, and domain-specific models.
- Establish and lead cost-performance governance reviews across AI systems, including tracking GPU utilization, model throughput, and inference cost efficiency.
- Lead team design councils or design review boards to maintain technical consistency and compliance with AI engineering standards.
- Mentor Principal and Manager-level AI engineers to support cross-domain learning and elevate organizational technical maturity.
Minimum qualifications
- Bachelor’s degree (Computer Science, AI, Electrical Engineering, Computer Engineering, or related) plus at least 6 years developing AI and ML algorithms or technologies, or a Master’s degree plus at least 4 years in the same area.
- At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- LLMs, vector search, similarity search, guardrails
Benefits
- Health, financial and other benefits that support total well-being.
Hybrid work
This role is designated as a hybrid position. You are expected to adhere to Capital One’s hybrid policy regarding required on-site presence at your designated office location.
Compensation and incentives
- Salary range for McLean, VA: USD 229,900 - 262,400 per year
- Performance-based incentive compensation may include cash bonus(es) and/or long term incentives (LTI).
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
Additional application and workplace notes
- This role is expected to accept applications for a minimum of 5 business days.
- No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable laws.
- Capital One promotes a drug-free workplace.
- Capital One will consider qualified applicants with a criminal history in accordance with applicable laws.
- Accommodation contacts: Capital One Recruiting at 1-800-304-9102 or [email protected].
- Recruiting process technical support: [email protected].
- Capital One does not provide, endorse nor guarantee third-party products, services, educational tools, or other information available through its site.
- Entity note: positions posted in Canada, the United Kingdom, and the Philippines are tied to the relevant Capital One entities listed in the posting.