DataJobs.io
← Back to all jobs

Job Description

Capital One is hiring a Sr. Director, AI Engineer (McLean, VA, remote) to architect responsible, reliable AI systems and lead a unified personalization engine for agent-led experiences.

Responsibilities

  • Architect a unified, low-latency personalization engine to model user intent, preferences, and constraints across multiple product verticals while protecting privacy and preventing context leakage.
  • Define representation, governance, and real-time injection of long-horizon user state into agentic planning loops, with proactive autonomy for exploratory tasks and strict determinism and trust guardrails for financial workflows.
  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that impact how associates work and how customers interact with Capital One.
  • Oversee end-to-end delivery of AI software components: foundation model training, LLM inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability (plus additional components as needed).
  • Make high-judgment build-vs-buy decisions across open source and SaaS AI technologies, including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
  • Introduce foundation model optimization techniques to improve scalability, cost, latency, and throughput for large-scale production AI systems.
  • Contribute to technical vision and the long-term roadmap for foundational AI systems at Capital One.
  • Attract and retain AI talent; nurture team development through learning, coaching, and staying current with state-of-the-art AI.
  • Drive enterprise-wide AI strategy and align product, research, risk, and data organizations around shared technical and ethical principles.
  • Establish a multi-year roadmap for scalable, reliable, and compliant AI systems to serve as shared enterprise infrastructure.
  • Champion Responsible-AI by embedding ethical, transparent, and explainable model practices across lines of business.
  • Oversee scaling of AI operations across hundreds of production use cases, including model lifecycle management, observability, and cost efficiency.

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field plus at least 10 years developing AI and ML algorithms or technologies, or a Master’s degree in a related field plus at least 8 years developing AI and ML algorithms or technologies.
  • At least 5 years of people leadership experience.

Team Description

  • The Intelligent Foundations and Experiences (IFX) team builds Capital One’s AI vision.
  • As the ecosystem shifts toward agent-led experiences, personalization becomes a dynamic, stateful memory and context layer, not a simple ranking model.
  • The team builds the core personalization service that tailors agentic behavior across different surfaces, from high-discovery workflows (for example, travel booking) to high-precision tasks (for example, paying bills with minimal margin for error).

Ideal Candidate

  • Expertise in context management, recommendation systems, or identity infrastructure, with experience evolving these concepts for the agentic era.
  • Strong understanding of the difference between predicting user preferences and executing user intent safely.
  • Background building high-throughput systems, stateful memory architectures, and advanced RAG pipelines with strict data partitioning.
  • Ability to define unified APIs, align stakeholders around system boundaries, and design for graceful degradation and absolute user trust.
  • Ability to interpret AI research and apply novel techniques judiciously in production.
  • Motivation to empower others through mentoring and coaching; hands-on leadership and leading by example.
  • Comfort tackling big, undefined problems with clarity; ability to share new ideas even when unproven.
  • Deep technical foundation in engineering and mathematics, with experience across hardware, software, and AI to identify optimization opportunities.
  • Resilient trailblazer mindset to forge new paths when routes are unknown.

Preferred Qualifications

  • 7+ years of experience managing and leading an engineering team.
  • 8+ years of experience deploying scalable and responsible AI solutions on cloud platforms (AWS, Google Cloud, Azure, or equivalent private cloud).
  • Experience developing AI/ML algorithms or technologies such as LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
  • Experience building agentic AI systems and agentic workflows.
  • Ability to articulate complex AI concepts with excellent communication and presentation skills.
  • Demonstrated experience leading leaders and multiple AI engineering organizations across product, platform, and applied research domains.
  • Proven success building enterprise-scale AI platforms and capabilities for diverse business lines and customer use cases.
  • Ability to influence executive leadership on AI investment strategy, organizational design, and risk management priorities.
  • Experience establishing external partnerships or thought leadership in AI, academia, or open-source communities.
  • Experience right-sizing models, instance counts, and hardware types based on requirements (such as context length, token inputs, and token outputs).

Technologies

  • AWS Ultraclusters
  • Huggingface
  • VectorDBs
  • PyTorch
  • Python
  • C++
  • C#
  • Java
  • CUDA
  • Golang
  • AWS
  • Google Cloud
  • Azure

Location and Compensation

  • Remote (regardless of location): $286,200 - $326,700
  • Cambridge, MA: $314,800 - $359,300
  • McLean, VA: $314,800 - $359,300
  • New York, NY: $343,400 - $392,000
  • San Francisco, CA: $343,400 - $392,000
  • San Jose, CA: $343,400 - $392,000
  • Performance-based incentive compensation may include cash bonus(es) and/or long-term incentives (LTI).
  • Incentives could be discretionary or non-discretionary depending on the plan.

Similar Jobs