Sr. Lead AI Engineer (GenAI Platform)

Capital One is building responsible and reliable AI systems to improve banking outcomes. In this Sr. Lead AI Engineering role, you will develop foundational GenAI capabilities, including LLM platform components, optimization, governance, observability, and delivery of AI-powered products.

Role Focus

You will help design, build, and operate components for foundational AI systems that support both real-world reliability and production performance. The work includes developing and deploying capabilities across foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.

Responsibilities

• Collaborate with cross-functional partners including engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that affect how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Use a mix of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and additional tools in the stack.
• Develop and introduce state-of-the-art LLM optimization techniques to improve performance metrics for production systems, including scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

Required Qualifications

• Bachelor’s degree in Computer Science/AI/EE/CE or a related field with at least 6 years of experience developing AI and ML algorithms or technologies, or a Master’s degree in the same areas with at least 4 years of experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Technologies

Work may involve AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, Open Source and SaaS tools, and foundational AI capabilities such as foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Additional technologies listed include Python, Go, Scala, Java, C++, C#, Golang, AWS, Google Cloud, and Azure.

Team Description

The Intelligent Foundations and Experiences (IFX) team is central to delivering Capital One’s AI vision. The team partners across the company to advance state-of-the-art science and AI engineering, and builds and deploys proprietary solutions that support business value and impact millions of customers. AI models and platforms enable teams across Capital One to enhance products with AI in responsible and scalable ways for high-leverage outcomes.

What You Will Contribute

• Build high-quality systems and take ownership of results while aligning with a focus on doing the right thing.
• Stay current with relevant research and apply novel techniques thoughtfully in production environments.
• Navigate complex and undefined problems, communicate findings clearly, and drive progress with disciplined investigation.
• Share and advocate for new ideas, including approaches that are not yet proven.

Preferred Qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (such as AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Ability to lead and mentor engineering teams and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (for example, LLM inference, similarity search and VectorDBs, guardrails, and memory) using Python, C++, C#, Java, or Golang.
• Experience developing and applying state-of-the-art techniques to optimize training and inference software for improved hardware utilization, latency, throughput, and cost.
• Excellent communication and presentation skills, including the ability to explain complex AI concepts to peers.

Compensation and Location

Location: New York, NY (onsite)

Salary: USD 250,800 - 286,200 per year

Benefits

• Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
• A comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being.

Additional Posting Details

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• Applications are expected to be accepted for a minimum of 5 business days.
• No agencies please. Capital One is an equal opportunity employer committed to non-discrimination in compliance with applicable federal, state, and local laws (EOE, including disability and veteran status).
• Capital One promotes a drug-free workplace.
• Capital One will consider qualified applicants with a criminal history in a manner consistent with applicable laws regarding criminal background inquiries.
• If you require accommodation while searching or applying, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected].
• For technical support or questions about the recruiting process, email [email protected].
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site.
• Capital One Financial is made up of several different entities.

About Capital One’s AI Mission

Capital One is creating responsible and reliable AI systems and continuing to build world-class applied science and engineering teams. The organization’s investments in technology infrastructure and machine learning experience aim to support scalable, high-performance AI infrastructure and breakthrough product experiences.