This position is no longer accepting applications
Closed on October 20, 2026.
This role is filled — get an email when new Artificial Intelligence roles open on DataJobs.io:
AI Engineer 5 (MLX, Agentic AI, Gen AI platform Services)
Agentic Ai
Artificial Intelligence
Engineer
Generative AI
GPU
Large Language Models
Machine Learning
Machine Learning Inference
Multi Agent Systems
View similar jobs
Get alerted when similar jobs are posted — set up a New Artificial Intelligence jobs on DataJobs.io alert.
See other roles at Capital One.
Job Description
Build and support AI-powered products and foundational AI systems that improve how associates work and how customers interact with Capital One.
Responsibilities
- Work with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products.
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Develop state-of-the-art foundation model optimization techniques to improve production performance across scalability, cost, latency, and throughput.
- Shape the technical vision and long-term roadmap for foundational AI systems.
- Design, implement, and optimize multi-model orchestration pipelines integrating LLMs, vector search, and domain-specific models into unified systems.
- Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency.
- Lead team design councils or design review boards to ensure technical consistency and compliance with AI engineering standards.
- Mentor Principal and Manager-level AI engineers to drive cross-domain learning and improve organizational technical maturity.
Requirements
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies; or Master’s degree plus at least 4 years of experience developing AI and ML algorithms or technologies.
- At least 6 years of programming experience with Python, Go, Scala, CUDA, or Java.
Technologies
- AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
- AWS, Google Cloud, Azure
- Python, Go, Scala, CUDA, Java, C++, C#, Golang
- LLMs, vector search, GPU utilization
- Rule-based, retrieval-augmented, generative components
Education
- Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields
Location
- San Jose, CA (onsite)
Salary
- USD 250,800 - 286,200 per year
Benefits
- Comprehensive, competitive, and inclusive health, financial, and other benefits to support total well-being
- Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
Team Description
- The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life.
- Collaborates across the company to advance state of the art in science and AI engineering.
- Builds and deploys proprietary solutions central to the business and value delivered to millions of customers.
- Enables teams across Capital One to enhance products with responsible and scalable AI.
Preferred Qualifications
- Experience leading development AI systems with tradeoff decisions across cost, latency, throughput, and accuracy
- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
- Experience designing, developing, delivering, and supporting complex AI systems
- Experience developing and applying AI and ML algorithms, including LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang
- Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
- Experience building agentic AI systems and agentic workflows
- Passion for staying current with AI research and applying novel techniques in production
- Excellent communication and presentation skills for explaining complex AI concepts to peers
- Experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components, into unified production pipelines
- Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes
- Ability to balance model performance and operational cost using dynamic inference strategies and model compression
- Experience right-sizing models, instance counts, and hardware types based on requirements such as context length and token inputs/outputs
Additional Notes
- Salary ranges vary by location for AI Engineer 5, including McLean, VA ($229,900 - $262,400), Cambridge, MA ($229,900 - $262,400), New York, NY ($250,800 - $286,200), San Francisco, CA ($250,800 - $286,200), and San Jose, CA ($250,800 - $286,200).