Senior Lead AI Engineer (FM Hosting)

Capital One's Intelligent Foundations and Experiences (IFX) team is seeking a Senior Lead AI Engineer (FM Hosting) to architect and operationalize AI software components that power scalable, real-time customer experiences. Based in New York, NY (onsite), the role offers a salary range of USD 250,800 to 286,200 per year and involves collaboration across engineering, research, and product management to shape AI systems that transform how associates work and how customers interact with Capital One.

Responsibilities

• Collaborate with a cross-disciplinary team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that transform how Capital One associates work and how customers interact with the bank.
• Design, build, test, deploy, and sustain AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Utilize a wide range of open-source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Develop and apply cutting-edge LLM optimization techniques to boost production AI systems' performance, focusing on scalability, cost, latency, and throughput.
• Contribute to Capital One's foundational AI systems' technical vision and long-term roadmap.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of experience developing AI and ML algorithms or technologies, or a Master's degree in the same fields with at least 4 years of experience developing AI and ML algorithms or technologies.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Technologies

• AWS Ultraclusters
• HuggingFace
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python
• C++
• C#
• Java
• Go

Benefits

• Health benefits
• Financial benefits
• Other benefits that support your total well-being
• Performance-based incentive compensation (cash bonuses and/or long term incentives)

Overview

Capital One is focused on building responsible and reliable AI systems that drive better banking outcomes. The company has long been a leader in applying machine learning to deliver real-time, personalized customer experiences, supported by strong technology infrastructure and top talent. This foundation positions Capital One at the forefront of enterprises leveraging AI to create value for customers.

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the core of Capital One's AI strategy. We collaborate with partners across the organization to advance AI research and engineering, building and deploying proprietary solutions central to the business and delivering value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance products with AI's transformative potential.

The Ideal Candidate

• You enjoy building robust systems, take pride in code quality, and share a commitment to doing the right thing. You are motivated by solving problems that can change banking for good.
• You stay current with the latest AI research and can translate publications into production-ready approaches.
• You adapt quickly and bring clarity to large, undefined problems, asking questions and digging deep to uncover root causes, and you can present findings concisely. You have the courage to propose new ideas, even if unproven.
• You are deeply technical with a solid foundation in engineering and mathematics, and you understand hardware, software, and AI to identify optimization opportunities others might miss.
• You are a resilient trailblazer who can chart new paths to meet business goals when the route is uncertain.

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang.
• Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Passion for staying abreast of the latest AI research and AI systems, applying novel techniques in production as appropriate.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.