Senior Lead AI Engineer (GenAI Platform Services)

Build responsible, reliable generative AI platform services that help power AI capabilities across Capital One. Join the Intelligent Foundations and Experiences (IFX) team and work with engineering, research, and product partners to advance the state of the art in science and AI engineering, deploying proprietary solutions with high leverage impact for millions of customers.

Location: New York, NY (onsite)
Salary: USD 250,800 - 286,200 per year

What you’ll do

• Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that improve how associates work and how customers interact with Capital One.
• Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Apply and integrate AI technologies across your stack, including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related open source and SaaS offerings.
• Introduce optimization techniques for large-scale production LLM systems to improve scalability, cost, latency, and throughput.
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.

What you bring

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 6 years of experience developing AI and ML algorithms or technologies, or Master’s degree in a related field plus at least 4 years of such experience.
• At least 6 years of programming experience with Python, Go, Scala, or Java.

Preferred qualifications

• 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (for example AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, or Golang.
• Experience applying state-of-the-art optimization techniques for training and inference software to improve hardware utilization, latency, throughput, and cost.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.

Compensation and benefits

• Eligible for performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
• Comprehensive, competitive, and inclusive set of health, financial and other benefits (eligibility varies).

Technologies you may work with

AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, AWS, Google Cloud, Azure, Python, Go, Scala, Java, C++, C#, Golang

Additional details

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position.
• This role is expected to accept applications for a minimum of 5 business days.
• No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• Accommodation: contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected].
• Recruiting process questions: email [email protected].

Salary by location (for this role): Cambridge, MA: $229,900 - $262,400; McLean, VA: $229,900 - $262,400; New York, NY: $250,800 - $286,200; San Jose, CA: $250,800 - $286,200. Candidates hired in other locations will be subject to the pay range for that location, with the annualized salary reflected in the offer letter.