DataJobs.io
← Back to all jobs
Capital One

AI Engineer 4 (Gen AI Platform Services)

McLean, VA $197k - $225k/yr Full time Posted 14d ago

Job Description

Join Capital One to help build foundation model and GenAI platform capabilities that power responsible, scalable AI across the bank. On the Intelligent Foundations and Experiences (IFX) team, you’ll design and deliver AI software and architectures that improve how associates work and how customers engage with Capital One. This hybrid role is based in McLean, VA.

What you’ll work on: LLM inference and training, agent and multi-agent workflows, similarity search, guardrails, evaluation and governance, observability, and performance optimization focused on cost, latency, and throughput. You’ll also help define technical direction through the team’s long-term roadmap for foundational AI systems.

Responsibilities

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that support associates and customer experiences.
  • Design, develop, test, deploy, and support AI software components such as foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
  • Apply Open Source and SaaS technologies including AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
  • Introduce optimization techniques to improve performance and scalability, with focus on cost, latency, throughput, and production effectiveness.
  • Own end-to-end architecture for complex AI systems, supporting maintainability, observability, and ethical alignment.
  • Define and maintain service-level objectives (SLOs) for AI reliability, including latency, uptime, and model performance drift.
  • Collaborate with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines.
  • Lead cross-functional technical reviews for new AI system deployments, ensuring security, data governance, and compliance standards are met.
  • Mentor Principal and Senior Associates on scalable design, performance tuning, and research-to-production translation.

Requirements

  • Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies; or Master’s degree plus at least 2 years of such experience.
  • At least 4 years of experience programming with Python, Go, Scala, CUDA, or Java.

Technology Stack

AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, AWS, Google Cloud, Azure, Python, Go, Scala, CUDA, Java, C++, C#, Golang

Benefits

  • Comprehensive, competitive, and inclusive health, financial, and other benefits to support total well-being.
  • Performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).

Team context: IFX brings Capital One’s AI vision to life by working with partners across the company and building proprietary AI solutions that deliver value to millions of customers. The team’s models and platforms help other teams enhance their products with AI in responsible and scalable ways.

Compensation (McLean, VA): $197,300 - $225,100 per year.

Hybrid work requirement: This role is designated as hybrid, with required on-site presence at your designated office location per Capital One’s hybrid policy.

Application window: Expected to accept applications for a minimum of 5 business days.

Similar Jobs