Capital One is building responsible, scalable AI foundations that power how associates work and how customers experience banking. On the Intelligent Foundations and Experiences (IFX) team, you will help design and deploy production AI systems, including foundation model capabilities and LLM inference, with an emphasis on reliability, governance, and end-to-end architecture.
This AI Engineer 4 role is based in New York, NY (onsite) and supports work that advances the state of the art in science and engineering while delivering solutions with high leverage for millions of customers.
What you’ll do
- Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Apply a broad stack of AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related open source and SaaS tooling.
- Develop state-of-the-art foundation model optimization techniques to improve performance across scalability, cost, latency, and throughput for large-scale production systems.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Own end-to-end architecture for complex AI systems, focusing on maintainability, observability, and ethical alignment.
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
- Partner with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
- Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.
Skills and experience
- Bachelor’s degree in Computer Science/AI or related fields plus at least 4 years of experience developing AI/ML algorithms or technologies, or Master’s degree plus at least 2 years.
- 4+ years programming with Python, Go, Scala, CUDA, or Java.
Technology areas you’ll work with
Examples include AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, Python, Go, Scala, CUDA, Java, AWS, Google Cloud, Azure, C++, C#, and TPU.
Preferred qualifications
- Experience leading development AI systems with tradeoffs across cost, latency, throughput, and accuracy.
- 6+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience designing, developing, delivering, and supporting AI services.
- Experience developing AI/ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
- Experience optimizing training and inference software for better hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and agentic workflows.
- Experience designing distributed systems for model training, evaluation, and online inference at very large scale (petabyte scale).
- Experience defining AI model governance processes such as producibility, lineage tracking, and automated retention schedules.
- Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms.
Compensation and incentives
Salary (location-based) for New York, NY: $215,200 - $245,600 per year.
This role may also be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits to support your total well-being.
Additional information
- Application timeline: expected to accept applications for a minimum of 5 business days.
- Capital One will consider sponsoring eligible applicants for employment authorization.
- No agencies please.
- Capital One is an equal opportunity employer and promotes a drug-free workplace.
- For accommodation requests: contact Capital One Recruiting at 1-800-304-9102 or RecruitingAccommodation@capitalone.com.
- For technical support or recruiting process questions: Careers@capitalone.com.
