AI Engineer 4 (AI Foundations)
Job Description
Capital One is hiring an AI Engineer 4 (AI Foundations) on the IFX team to design and deploy responsible, reliable AI systems. This onsite role in New York, NY focuses on foundation model and LLM components, performance optimization for training and inference, and ownership of architecture, reliability metrics, and governance.
Key Responsibilities
- Partner with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that support how associates work and how customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Work with a stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch, as well as additional tools.
- Develop and introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Own end-to-end architecture for complex AI systems, supporting maintainability, observability, and ethical alignment.
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
- Collaborate with infrastructure engineering to optimize GPU and TPU utilization and accelerate model inference pipelines.
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
- Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.
Required Qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields, plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 2 years of experience.
- At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- TPU, GPU
Team Overview
The Intelligent Foundations and Experiences (IFX) team is central to bringing Capital One’s AI vision to life. The team works with partners across the company to advance the state of the art in science and AI engineering, and builds and deploys proprietary solutions that deliver value to millions of customers. AI models and platforms support teams across Capital One in enhancing products with responsible and scalable AI.
Additional Information
- This role is onsite in New York, NY.
- Salary range (New York, NY): USD 215,200 - 245,600 per year for AI Engineer 4.
- The role may be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI), depending on the plan.
- Capital One is expected to accept applications for a minimum of 5 business days.
- Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
- No agencies please.
- Capital One is an equal opportunity employer (EOE), committed to non-discrimination in compliance with applicable federal, state, and local laws.
- Capital One promotes a drug-free workplace.
- Accommodation requests: contact Capital One Recruiting at 1-800-304-9102 or [email protected].
- Technical support for recruiting process: [email protected].