AI Engineer 4
Job Description
Capital One is building responsible and reliable AI capabilities through its Intelligent Foundations and Experiences (IFX) team, focused on advancing AI science and engineering into production systems. As an AI Engineer 4 in the New York area (hybrid), you will help design, develop, deploy, and support AI software components spanning foundation models, LLM inference, agents and workflows, and evaluation and governance.
This role centers on delivering AI-powered functionality while maintaining ethical alignment, reliability, and observability across end-to-end architectures. You will collaborate with engineering, research, product, and technical program partners to bring scalable, high-impact AI to millions of customers.
Responsibilities
- Work with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related tools.
- Develop state-of-the-art foundation model optimization techniques to improve performance across scalability, cost, latency, and throughput for production AI systems.
- Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Own end-to-end architecture for complex AI systems, supporting maintainability, observability, and ethical alignment.
- Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
- Partner with infrastructure engineering to optimize GPU/TPU utilization and improve throughput in model inference pipelines.
- Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance requirements are met.
- Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.
Requirements
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 4 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 2 years of experience.
- At least 4 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java
- C++, C#, Golang
- GPU/TPU
Team Context
- The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life through science and AI engineering partnerships across the company.
- The team builds and deploys proprietary solutions central to the business, delivering value to millions of customers.
- AI models and platforms from IFX enable teams across Capital One to enhance products with responsible and scalable AI.
Hybrid Work
This role is designated as hybrid, with required on-site presence at your designated office location according to Capital One’s hybrid policy.
Compensation and Incentives
- New York, NY (hybrid): USD 215,200 - 245,600 per year
- Performance-based incentive compensation may include cash bonus(es) and/or long term incentives (LTI).
Application Details
- Applications are expected to be accepted for a minimum of 5 business days.