DataJobs.io
← Back to all jobs

Job Description

The Director, AI Engineer for the Data ML Platform role leads engineering for data and machine learning platform capabilities that support foundation models and AI systems for Responsible AI at scale.

Location and Work Style

San Francisco, CA (hybrid). This role is designated as a hybrid position, with adherence to Capital One’s hybrid policy for required on-site presence at the designated office location.

Compensation

USD 269,100 - 335,100 per year.

Role Responsibilities

  • Partner with a cross-functional group of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that support how associates work and how customers interact with Capital One.
  • Oversee end-to-end design, development, testing, deployment, and support of AI software components, including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Make high-judgment build-versus-buy decisions across a broad stack of Open Source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and others.
  • Develop and introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
  • Contribute to the technical vision and long-term roadmap for foundational AI systems at Capital One.
  • Attract and retain top AI talent and support personal and professional development through a culture focused on learning and staying current with the state of the art.
  • Translate enterprise AI strategy into portfolio-level execution plans across multiple product areas, balancing innovation with delivery discipline.
  • Scale AI engineering practices across teams using shared infrastructure, reusable components, and unified observability and governance frameworks.
  • Establish enterprise standards for Responsible AI, including fairness metrics, model evaluation protocols, documentation requirements, and audit readiness.
  • Work with research, compliance, and enterprise risk teams to support alignment with emerging ethical and regulatory standards.

Required Qualifications

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a Master’s degree plus at least 6 years of experience.
  • At least 3 years of people leadership experience.

Technologies

  • AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure
  • Python, C++, C#, Java, CUDA, Golang

Benefits

  • Eligible to earn performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
  • Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being.

Team Overview

The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life. The team works with partners across the company to advance the state of the art in science and AI engineering, building and deploying proprietary solutions that support business value for millions of customers.

IFX empowers teams across Capital One to enhance products with AI at scale. The team focuses on turning data into model-ready representations efficiently, so scientists can test data hypotheses in days rather than months.

About the Ideal Candidate

  • Engineering leader embedded in science and research teams, shaping experiments and converting research ideas into data systems without waiting for handoffs.
  • Builds reliable, reproducible, and versioned infrastructure so experiments can be traced to the exact data used; balances pipeline hardening with iteration speed when appropriate.
  • Leads engineers while partnering with science leadership, prioritizing engineering investments that speed the overall research loop.
  • Hands-on approach when needed, with pride in quality and a focus on doing the right thing.
  • Stays current with AI research and can apply novel techniques judiciously in production.
  • Empowers others through mentoring and coaching; drives professional development while leading by example.
  • Thrives on clarity for complex, undefined problems; investigates to identify root causes and communicates findings concisely.
  • Strong technical foundation in engineering and mathematics, with ability to identify optimization opportunities across hardware, software, and AI.
  • Resilient and proactive, able to forge new paths when the route is not established.

Salary Ranges by Location (Director, AI Engineer)

  • San Francisco, CA: $293,600 - $335,100
  • Cambridge, MA: $269,100 - $307,200
  • McLean, VA: $269,100 - $307,200
  • New York, NY: $293,600 - $335,100
  • San Jose, CA: $293,600 - $335,100

Education

Bachelor’s or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields.

Similar Jobs