Senior Lead AI Engineer
Job Description
Capital One is hiring a Senior Lead AI Engineer on the Intelligent Foundations and Experiences (IFX) team in McLean, VA (onsite) to build and deploy responsible, scalable AI systems and LLM-enabled products.
Responsibilities
- Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers
- Design, develop, test, deploy, and support AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
- Apply Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, and Nemo Guardrails, along with PyTorch and related tooling
- Develop state-of-the-art LLM optimization techniques to improve production performance (scalability, cost, latency, throughput)
- Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One
Requirements
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies
- OR Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies
- At least 6 years of experience programming with Python, Go, Scala, or Java
Technologies
- AWS Ultraclusters
- Huggingface
- VectorDBs
- Nemo Guardrails
- PyTorch
- Python, Go, Scala, Java
- C++, C#, Golang
- AWS, Google Cloud, Azure
Team
- The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
- Partners across the company to advance science and AI engineering, and build and deploy proprietary solutions central to business outcomes
- Builds AI models and platforms that enable teams across Capital One to enhance products with responsible, scalable AI
Benefits
- Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being
Preferred Qualifications
- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud)
- Experience designing, developing, integrating, delivering, and supporting complex AI systems
- Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders
- Experience developing AI and ML algorithms or technologies (LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
- Passion for staying abreast of AI research and applying novel techniques judiciously in production
- Excellent communication and presentation skills for articulating complex AI concepts
Salary and Incentives
- McLean, VA (onsite): USD 229,900 - 262,400 per year
- Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI)