AI Engineer 3 (AI Foundations)
Job Description
Capital One is building foundational AI systems that can be trained, deployed, and operated responsibly at scale. On the Intelligent Foundations and Experiences (IFX) team, you will help design and deliver AI software components that support foundation model training, LLM inference, agent workflows, and the measurement, governance, and observability needed for production use.
This hybrid role is based in New York, NY, and focuses on engineering work across the full lifecycle of foundational AI systems, from data curation and evaluation to deployment pipelines and model traceability.
What you’ll do
- Work with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components spanning foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a mix of open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
- Develop optimization techniques for foundation models to improve production performance across scalability, cost, latency, and throughput.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Lead development and benchmarking of multi-turn conversational and tool-using agent workflows, with measurable performance and safety metrics.
- Build scalable pipelines for training, fine-tuning, and deploying foundation models or domain-specific models across multiple environments.
- Collaborate with research and data engineering teams to curate high-quality datasets and improve model evaluation methodologies.
- Support governance and security efforts for model traceability, lineage documentation, and version control of deployed AI assets.
- Mentor junior AI engineers and promote engineering excellence, reproducibility, and responsible experimentation.
Required qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 3 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 1 year of experience developing AI and ML algorithms or technologies.
- At least 3 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technologies and focus areas
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS
- Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- Foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, observability, and retrieval-augmented generation (RAG)
Compensation and benefits
- Salary (New York, NY): USD 176,500 - 201,400 per year.
- Comprehensive, competitive, and inclusive health, financial, and other benefits to support total well-being.
- Incentive compensation eligibility, which may include cash bonus(es) and/or long term incentives (LTI).
Team and work style
- The Intelligent Foundations and Experiences (IFX) team is positioned at the center of bringing Capital One’s AI vision to life.
- This role is designated as hybrid. You are expected to follow Capital One’s hybrid policy for required on-site presence at your designated office location.
Additional administrative statements
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
- Capital One expects to accept applications for a minimum of 5 business days.
- No agencies please.
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
- Capital One promotes a drug-free workplace.
- Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.