AI Engineer 4 (Gen AI Platform Services)
Job Description
Capital One is seeking an AI Engineer 4 for Gen AI Platform Services within the Intelligent Foundations and Experiences (IFX) team. In this hybrid role based in New York, you will help design, build, deploy, and support foundational AI systems and the production-grade components that power large language model and agent experiences.
What You Will Do
- Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that support associates and improve customer interactions.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a broad stack of open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and other related tools.
- Develop and introduce foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
- Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Own end-to-end architecture for complex AI systems with a focus on maintainability, observability, and ethical alignment.
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
- Work with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
- Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.
Required Qualifications
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus at least 4 years of experience developing AI and ML algorithms or technologies; or a Master’s degree in a related field plus at least 2 years of experience developing AI and ML algorithms or technologies.
- At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.
Technologies and Skills
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- GPU/TPU
- Large language model inference, similarity search and VectorDBs
- Guardrails, memory, foundation model training
- Multi-agent workflows
Team Overview
The Intelligent Foundations and Experiences (IFX) team brings Capital One’s vision for AI to life. The team partners across the organization to advance state-of-the-art science and AI engineering, and it builds and deploys proprietary solutions central to the business. IFX teams deliver AI models and platforms that help other teams enhance products with responsible, scalable AI for high-leverage impact.
Hybrid Work Requirement
This role is designated as hybrid. You are expected to adhere to Capital One’s hybrid policy regarding required on-site presence at your designated office location.
Salary, Location, and Incentives
Location: New York, NY (hybrid)
Salary range (full-time annual): $215,200 - $245,600 (AI Engineer 4)
Additional locations and ranges (minimum and maximum full-time annual salaries) listed for this role include: Cambridge, MA ($197,300 - $225,100); McLean, VA ($197,300 - $225,100); San Francisco, CA ($215,200 - $245,600); San Jose, CA ($215,200 - $245,600).
This role is also eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.
Application Timeline
This role is expected to accept applications for a minimum of 5 business days.