AI Engineer 5

Capital One is seeking an AI Engineer 5 to design, build, and deploy responsible and scalable AI systems for the banking industry. The role emphasizes foundation model training and inference, LLM and agent workflows, orchestration, optimization, governance, and observability.

Responsibilities

• Collaborate with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
• Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Apply a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, and PyTorch.
• Develop foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
• Shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
• Design and optimize multi-model orchestration pipelines that integrate LLMs, vector search, and domain-specific models into unified systems.
• Establish and lead cost-performance governance reviews across AI systems, tracking GPU utilization, model throughput, and inference cost efficiency.
• Lead team design councils or design review boards to support technical consistency and compliance with AI engineering standards.
• Mentor Principal and Manager-level AI engineers to support cross-domain learning and increase organizational technical maturity.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in a related field plus at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, CUDA, or Java.

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch
• Python, Go, Scala, CUDA, Java
• AWS, Google Cloud, Azure
• C++, C#, Golang

Preferred Qualifications

• Experience leading development of AI systems with tradeoff decisions across cost, latency, throughput, and accuracy.
• 7+ years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud environments.
• Experience designing, developing, delivering, and supporting complex AI systems.
• Experience developing AI and ML algorithms or technologies (including LLM inference, similarity search and VectorDBs, guardrails, and memory) using Python, C++, C#, Java, CUDA, or Golang.
• Experience applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost.
• Experience building agentic AI systems and agentic workflows.
• Ability to stay current with AI research and apply novel techniques appropriately in production.
• Excellent communication and presentation skills for explaining complex AI concepts to peers.
• Experience architecting and integrating heterogeneous AI systems, including rule-based, retrieval-augmented, and generative components, into unified production pipelines.
• Experience defining and enforcing standards for ethical AI deployment, including explainability, fairness, and human-in-the-loop review processes.
• Demonstrated ability to balance model performance and operational cost using dynamic inference strategies and model compression.
• Experience right-sizing models, instance counts, and hardware types based on requirements such as context length, token inputs, and token outputs.

Location and Salary

New York, NY (onsite)

$250,800 - $286,200 per year

Minimum experience: 6 years

Education: Bachelor's Degree or Master's degree in Computer Science/AI or related fields

Incentive Compensation

This role may be eligible for performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI).

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits to support total well-being.

Additional Information

• Applications are expected to be accepted for a minimum of 5 business days.
• No agencies please.
• Capital One is an equal opportunity employer (EOE), committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Capital One considers qualified applicants with a criminal history in accordance with applicable laws.
• For accommodation requests, contact Capital One Recruiting at 1-800-304-9102 or at [email protected].
• For technical support or questions about the recruiting process, email [email protected].
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
• Capital One Financial consists of multiple entities, and roles posted in Canada, the United Kingdom, or the Philippines correspond to specific entities.