Staff AI Engineer
Job Description
Capital One is building intelligent, agent-led experiences that require AI to be both reliable and fast. In this Remote Eligible Staff AI Engineer role in McLean, VA, you will help design enterprise AI foundations and a low-latency personalization engine that supports stateful interactions across banking workflows, with an emphasis on responsible AI.
The Intelligent Foundations and Experiences (IFX) team is at the center of turning Capital One’s vision for AI into production. As experiences shift toward agents, personalization becomes more than ranking: it functions as a dynamic memory and context layer that can tailor agentic behavior across both exploratory workflows (like travel booking) and high-precision, low-margin-for-error tasks (like paying bills).
What you’ll do
- Architect a unified, low-latency personalization engine that models user intent, preferences, and constraints across product verticals without leaking context or compromising privacy.
- Define representation, governance, and real-time injection of long-horizon user state into agentic planning loops, balancing proactive autonomy with strict determinism and trust guardrails in financial workflows.
- Collaborate with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products for associates and customers.
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Use a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, PyTorch, and more.
- Introduce state-of-the-art foundation model optimization techniques to improve scalability, cost, latency, and throughput in production AI systems.
- Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One.
- Set enterprise-wide AI architecture direction by unifying tooling, observability, and deployment standards across teams.
- Own design and integration of model routing, caching, and orchestration systems for hybrid and multi-model workloads.
- Advance responsible AI across system design, focusing on transparency, reproducibility, and fairness-by-design.
- Drive internal education and mentorship through architecture councils and AI guilds, sharing best practices.
Required qualifications
- Bachelor’s Degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 8 years of experience developing AI and ML algorithms or technologies, or a Master’s Degree in the same fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
- At least 8 years of experience programming with Python, Go, Scala, CUDA, or Java.
Preferred qualifications
- Experience designing AI systems with tradeoffs among cost, latency, throughput, and accuracy.
- 8+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience architecting, designing, developing, integrating, delivering, and supporting complex AI systems.
- Ability to lead and mentor multiple engineering teams and influence cross-functional stakeholders up to the VP level.
- Experience developing and applying state-of-the-art AI/ML techniques for LLM inference, similarity search and VectorDBs, guardrails, and memory using Python, C++, C#, Java, CUDA, or Golang.
- Experience optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- Experience building agentic AI systems and agentic workflows.
- Excellent communication and presentation skills for explaining complex AI concepts to peers.
- Proven track record defining and operationalizing enterprise AI architecture standards, including data pipeline governance, observability, and evaluation frameworks.
- Experience leading federated or multi-cloud AI strategies to improve resilience, compliance, and compute efficiency.
- Experience guiding research-to-production promotion, including model handoff, evaluation, and productization.
- Experience defining north-star metrics that balance business value, innovation velocity, cost, and ethical responsibility.
- Experience right-sizing models, instance counts, and hardware types based on requirements (e.g., context length, token inputs, token outputs).
Technologies
- AWS Ultraclusters
- Huggingface
- VectorDBs
- PyTorch
- Python, Go, Scala, CUDA, Java
- Open Source, SaaS
Location and remote policy
- Location: McLean, VA (Remote Eligible)
- Capital One is open to hiring a Remote or Hybrid Employee. If Hybrid, required on-site presence applies based on the designated office location. If Remote, Remote Worker Expectations apply.
Compensation
- Remote (Regardless of Location): $244,700 - $279,200
- McLean, VA: $269,100 - $307,200
- This role may also be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. Applications are expected to be accepted for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) and promotes a drug-free workplace.