Sr. Manager, AI Engineer

At Information Technology Senior Management Forum, this onsite role in San Jose, CA focuses on delivering responsible, scalable AI-powered products through a cross-functional engineering and research partnership. The Sr. Manager will oversee key AI software components spanning foundation model training, LLM inference, search, guardrails, evaluation, experimentation, governance, and observability, while shaping the long-term technical roadmap for foundational AI systems.

What you’ll do

• Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One
• Lead end-to-end design, development, testing, deployment, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability
• Make high-judgment build-versus-buy decisions across an AI technology stack that may include AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and related Open Source and SaaS tools
• Introduce foundation model optimization techniques aimed at improving production performance across scalability, cost, latency, and throughput
• Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One
• Attract, retain, and develop AI talent by fostering a culture of continuous learning and awareness of state-of-the-art AI
• Translate enterprise AI goals into actionable team roadmaps with measurable outcomes and regular readouts
• Operationalize Responsible AI by establishing review gates, documentation and evaluation requirements, and rollout or rollback standards for production AI systems
• Build collaboration interfaces with Research, Data, and Platform teams to accelerate the model lifecycle

Minimum qualifications

• Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies, or Master’s degree plus at least 4 years of such experience
• At least 1 year of people leadership experience

Technologies

• AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
• Python, C++, C#, Java, CUDA, Golang

Preferred qualifications

• 3 years of experience managing and leading an engineering team
• 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
• Experience developing AI and ML algorithms or technologies (e.g., LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, CUDA, or Golang
• Experience building agentic AI systems and agentic workflows
• Passion for staying current with AI research and applying novel techniques in production
• Excellent communication and presentation skills for articulating complex AI concepts
• Experience leading technical strategy for a multi-disciplinary AI team, balancing research exploration with production delivery
• Familiarity with MLOps and AI observability (evaluation pipelines, drift monitoring, model or version governance) to support reliability and compliance
• Track record mentoring engineers or scientists to productize prototypes and meet production SLOs
• Experience right-sizing models, instance counts, and hardware types based on requirements (e.g., context length, token inputs, token outputs)

Salary (San Jose, CA): USD 250,800 - 286,200 per yearly. Posted date: 9/21/2026.

Incentive compensation: Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI). Incentives may be discretionary or non-discretionary depending on the plan.

Application notes: The role is expected to accept applications for a minimum of 5 business days. No agencies please.

Accommodation and recruiting contact: For employment opportunity information or to apply, contact Capital One Recruiting at 1-800-304-9102 or via [email protected] if an accommodation is required. For technical support or questions about the recruiting process, email [email protected].