Lead AI Engineer

Capital One is hiring a Lead AI Engineer to build responsible, reliable AI systems and LLM-enabled capabilities for production use.

• Partner with cross-functional teams across engineering, research science, technical program management, and product management to deliver AI-powered products for associates and customers
• Design, develop, test, deploy, and support AI software components, including:
  • Foundation model training
  • Large language model inference
  • Similarity search
  • Guardrails
  • Model evaluation
  • Experimentation
  • Governance and observability
• Apply Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tooling
• Develop state-of-the-art LLM optimization techniques to improve production performance including scalability, cost, latency, and throughput
• Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One

Requirements

• Bachelor’s or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus:
  • At least 4 years experience developing AI and ML algorithms or technologies, OR
  • At least 2 years experience developing AI and ML algorithms or technologies
• At least 4 years of programming experience with Python, Go, Scala, or Java

Preferred Qualifications

• At least 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience designing, developing, delivering, and supporting AI services
• Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
• Interest in staying current with AI research and applying novel techniques judiciously in production

Technologies

• AWS Ultraclusters
• Huggingface
• VectorDBs
• Nemo Guardrails
• PyTorch
• Foundation model training
• Large language model inference
• Similarity search
• Guardrails
• Model evaluation
• Experimentation
• Governance
• Observability
• Python, Go, Scala, Java
• AWS, Google Cloud, Azure
• C++, C#, Golang

Team

• The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
• IFX partners across the company to advance science and AI engineering and deploy proprietary solutions central to the business
• AI models and platforms help teams enhance products with responsible, scalable AI for high-leverage impact

Benefits

• Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being
• Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Location

• New York, NY (onsite)

Salary

• USD 215,200 - 245,600 per year

Additional Information

• Capital One may consider sponsoring a new qualified applicant for employment authorization for this position
• Application window: expected to accept applications for a minimum of 5 business days
• No agencies please
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
• Capital One promotes a drug-free workplace
• Capital One will consider for employment qualified applicants with a criminal history consistent with applicable laws
• Accommodation: contact Capital One Recruiting at 1-800-304-9102 or [email protected]
• Recruiting process support: [email protected]
• Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or information on this site
• Capital One Financial includes multiple entities; postings in other countries correspond to specific entities