Capital One is seeking a Distinguished AI Engineer to help design and deliver an enterprise Generative AI Platform with agent orchestration, guardrails, memory, and developer tooling. This on-site role in New York involves close collaboration across engineering, research, program management, and product teams to create safe, scalable AI-powered products used by millions. The position carries a salary range of USD 293,600 to 335,100 per year.
Responsibilities
- Collaborate with a cross-functional team of engineers, researchers, program managers, and product managers to deliver AI-powered products that transform how our associates work and how customers interact with Capital One.
- Contribute to the north star platform architecture, continually publishing living diagrams and canonical APIs covering agent orchestration, RAG pipelines, prompt libraries, and multi-tenant policy enforcement.
- Standardize and automate agentic workflows by evaluating frameworks such as LangGraph, AutoGen, Semantic Kernal, CrewAI, and LlamaIndex, then blend patterns that meet enterprise SLAs so 90% of new apps can adopt them.
- Enhance developer experience by helping build an end-to-end GenAI SDK, CLI, and starter kits that let AI engineers spin up secure, observable agentic workflows in minutes, reducing prototyping to production timelines by about 30%.
- Prioritize trust and safety through central guardrail services—prompt firewalls, content-filter hooks, red team harnesses, and audit APIs—used by every application to drive toward zero Sev4 incidents.
- Partner with cross-organization architects to boost end-to-end performance via orchestration optimizations such as batching, retrieval caching, and heuristic tuning, while incubating PoCs and RFCs for features like hierarchical agent memory and multimodal guardrails.
- Own central Helm charts, operators, and CRDs to auto-scale agents and meet tenant SLAs.
- Coach and evangelize by hosting architecture office hours, mentoring Staff, Principal, and Senior engineers, authoring technical design documents and blogs, and representing Capital One at Tier 1 AI conferences to amplify the platform vision.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or AI with at least 8 years of experience developing AI and ML algorithms or technologies, or a Master’s degree with at least 6 years of relevant experience.
- At least 8 years of programming experience in Python, Go, Scala, or Java.
Technologies
- Python, Go, Scala, Java
- LangGraph, AutoGen, Semantic Kernal, CrewAI, LlamaIndex
- LangChain
- Google Cloud Vertex AI, Amazon SageMaker, Azure Machine Learning
- Kubernetes, Helm, Operators, CRDs
Benefits
- Health benefits
- Financial benefits
- Performance-based incentive compensation (cash bonuses and/or long-term incentives), discretionary or non-discretionary depending on the plan
Team Description
The Intelligent Foundations and Experiences (IFX) team sits at the core of Capital One’s AI ambitions. We collaborate with partners across the company to advance state-of-the-art AI engineering, building and deploying proprietary solutions that form a cornerstone of the business and deliver value to millions of customers. Our AI models and platforms empower teams to enhance products with the transformative power of AI.
Why This Role Matters
We are crafting an enterprise Generative AI Platform that enables multiple product teams to compose powerful, safe, and explainable AI capabilities without the burden of model internals or infrastructure concerns. The role centers on designing the agentic workflow framework and shared services such as memory, guardrails, vector search, SDKs, and blueprints that translate foundation model power into production-grade applications used across several lines of business.
