Lead AI Engineer (MLX)

Capital One is hiring a Lead AI Engineer (MLX) to help build responsible, reliable AI systems for banking.

Responsibilities

• Work with cross-functional teams (engineers, research scientists, technical program managers, and product managers) to deliver AI-powered products for associates and customers
• Design, develop, test, deploy, and support AI software components including:
  • Foundation model training
  • Large language model inference
  • Similarity search
  • Guardrails
  • Model evaluation, experimentation, governance, and observability
• Use a broad stack of open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and PyTorch
• Develop and introduce state-of-the-art LLM optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems
• Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One

Requirements

• Education & experience:
  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years developing AI and ML algorithms or technologies
  • Or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years developing AI and ML algorithms or technologies
• Programming: at least 4 years programming with Python, Go, Scala, or Java

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Python, Go, Scala, Java
• AWS, Google Cloud, Azure
• C++, C#, Golang

Preferred Qualifications

• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, delivering, and supporting AI services
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang
• Experience applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Passion for staying current with AI research and using novel techniques judiciously in production

Team

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
• Works with partners across the company to advance science and AI engineering
• Builds and deploys proprietary solutions that support business goals and deliver value to millions of customers
• Enables teams across Capital One to enhance products with responsible and scalable AI

Salary / Location

• Location: New York, NY (onsite)
• Salary: USD 215,200 - 245,600 per year
• Other posted locations may have different ranges (Cambridge, MA; McLean, VA; San Francisco, CA; San Jose, CA)
• Eligible for performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Benefits

• Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being

Policies / Additional Information

• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
• No agencies please
• Equal Opportunity Employer (EOE), committed to non-discrimination in compliance with applicable federal, state, and local laws
• Promotes a drug-free workplace
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or other information available through this site
• Expected application acceptance: minimum of 5 business days

Accessibility / Recruiting Contact

• For accommodation requests: contact Capital One Recruiting at 1-800-304-9102 or [email protected]
• For technical support or questions about recruiting process: [email protected]

Please note: positions posted in Canada are for Capital One Canada, the United Kingdom are for Capital One Europe, and the Philippines are for Capital One Philippines Service Corp. (COPSSC).