Senior Lead AI Engineer

Capital One is seeking a Senior Lead AI Engineer for an onsite role in New York, NY. The position focuses on building and deploying AI and ML systems, contributing to foundational AI platforms, and steering cross-functional teams to deliver AI powered products. Compensation: USD 250,800 - 286,200 per year.

Responsibilities

• Collaborate with a cross-functional team of engineers, researchers, technical program managers, and product managers to deliver AI powered products that transform how associates work and how customers interact with Capital One.
• Own the design, development, testing, deployment, and support of AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
• Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, HuggingFace, VectorDBs, Nemo Guardrails, PyTorch, and more.
• Invent and apply state-of-the-art LLM optimization techniques to enhance production AI systems in terms of scalability, cost, latency, and throughput.
• Contribute to the technical vision and the long-term roadmap of foundational AI systems at Capital One.

Requirements

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML experience, or a Master’s degree in the same fields with at least 4 years of AI/ML experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.
• Seven years of experience deploying scalable and responsible AI solutions on cloud platforms such as AWS, Google Cloud, Azure, or equivalent private cloud.
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and vector databases, guardrails, memory) using Python, C++, C#, Java, or Go.
• Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
• Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production.
• Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.

Technologies

• Python
• Go
• Scala
• Java
• AWS Ultraclusters
• HuggingFace
• VectorDBs
• Nemo Guardrails
• PyTorch

Benefits

• Health, financial and other benefits that support total well-being
• Performance-based incentive compensation, which may include cash bonuses and/or long term incentives (LTI); incentives could be discretionary or non discretionary depending on the plan

Team Description

The Intelligent Foundations and Experiences (IFX) team sits at the center of Capital One's AI strategy. We work with partners across the company to advance the state of the art in AI research and engineering, building and deploying proprietary solutions that are central to the business and deliver value to millions of customers. Our AI models and platforms empower teams to enhance products with the transformative power of AI.

The Ideal Candidate

You enjoy building systems, take pride in the quality of your work, and share a commitment to doing the right thing. You stay current with the latest AI research and can judiciously apply novel techniques in production. You adapt quickly and seek clarity in large, undefined problems, communicating findings concisely. You are deeply technical, with a strong foundation in engineering and mathematics, and you recognize optimization opportunities that others may miss. You are a resilient trailblazer who can forge new paths to achieve business goals when the route is unknown.

Basic Qualifications

• Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields with at least 6 years of AI/ML experience, or a Master’s degree in the same fields with at least 4 years of AI/ML experience.
• At least 6 years of experience programming with Python, Go, Scala, or Java.

Preferred Qualifications

• Seven years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
• Experience designing, developing, integrating, delivering, and supporting complex AI systems.
• Proven ability to lead and mentor an engineering team and influence cross-functional stakeholders.
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Go.
• Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost using state-of-the-art techniques.
• Strong interest in AI research and AI systems, with the ability to apply novel techniques in production.
• Excellent communication and presentation skills to articulate complex AI concepts to peers.