Senior Lead AI Engineer(MLX, Agentic AI, Gen AI platform Services)

Capital One is seeking a Senior Lead AI Engineer to steer the development of AI software components and foundational AI systems for MLX, Agentic AI, and Gen AI platform services. This onsite role is based in New York, NY, with a compensation range of USD 250,800 to 286,200 per year.

Overview

Capital One is building responsible and reliable AI systems to advance banking for good. The organization has a track record of applying machine learning to deliver real time, personalized experiences for customers. This role contributes to scaling AI infrastructure and capabilities across the enterprise, supported by robust technology foundations and a strong talent pool.

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the heart of Capital One’s AI efforts. We collaborate with partners across the business to push the boundaries of science and engineering in AI, deploying proprietary solutions that underpin core products and deliver value to millions of customers. Our models and platforms empower teams to enhance products with AI driven capabilities.

Responsibilities

• Work with a cross functional group of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that reshape how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components, including foundation model training.
• Large language model inference and related components such as similarity search and guardrails.
• Model evaluation, experimentation, governance, and observability to ensure reliable production systems.
• Utilize and integrate a broad stack of Open Source and SaaS AI technologies including AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Develop and apply advanced LLM optimization techniques to enhance scalability, cost efficiency, latency, and throughput for large scale production AI systems.
• Contribute to the technical vision and long term roadmap of foundational AI systems at Capital One.

Technologies

• AWS Ultraclusters
• HuggingFace
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python
• Go
• Scala
• Java
• C++
• C#

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, or Java

Benefits

• Health benefits
• Financial benefits
• Other benefits

Basic Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies
• Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
• At least 6 years of experience programming with Python, Go, Scala, or Java

Preferred Qualifications

• Seven years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud
• Experience designing, developing, integrating, delivering, and supporting complex AI systems
• Proven ability to lead and mentor an engineering team and influence cross functional stakeholders
• Experience developing AI and ML algorithms or technologies including LLM inference, similarity search and vector databases, guardrails, and memory using Python, C++, C#, Java, or Golang
• Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Strong interest in current AI research and practical application of new techniques in production
• Excellent communication and presentation skills for conveying complex AI concepts to peers