Senior Lead AI Engineer (Gen AI Platform Services, Agentic AI)
Job Description
Responsibilities
- Partner with a cross functional team of engineers, research scientists, technical program managers, and product managers to deliver AI powered products that transform how our associates work and how our customers interact with Capital One.
- Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
- Leverage a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more.
- Invent and introduce state of the art LLM optimization techniques to improve performance metrics such as scalability, cost, latency, and throughput for large scale production AI systems.
- Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One.
Requirements
- Bachelor's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 6 years of experience developing AI and ML algorithms or technologies.
- Master's degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years of experience developing AI and ML algorithms or technologies.
- At least 6 years of experience programming with Python, Go, Scala, or Java.
Technologies
- Python
- Go
- Scala
- Java
- AWS Ultraclusters
- Huggingface
- VectorDBs
- Nemo Guardrails
- PyTorch
Preferred Qualifications
- 7 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g. AWS, Google Cloud, Azure, or equivalent private cloud).
- Experience designing, developing, integrating, delivering, and supporting complex AI systems.
- Demonstrated ability to lead and mentor an engineering team and influence cross-functional stakeholders.
- Experience developing AI and ML algorithms or technologies (e.g. LLM Inference, Similarity Search and VectorDBs, Guardrails, Memory) using Python, C++, C#, Java, or Golang.
- Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost.
- Passion for staying abreast of the latest AI research and AI systems, and judiciously apply novel techniques in production.
- Excellent communication and presentation skills, with the ability to articulate complex AI concepts to peers.
Compensation and Benefits
The base salary range for this role varies by location, with explicit ranges listed for several cities. The listed range for McLean, VA is $229,900 - $262,400. Other posted locations show ranges such as $250,800 - $286,200 for New York, SF, and San Jose, or $229,900 - $262,400 for Cambridge.
- McLean, VA: $229,900 - $262,400
- New York, NY: $250,800 - $286,200
- Cambridge, MA: $229,900 - $262,400
- San Francisco, CA: $250,800 - $286,200
- San Jose, CA: $250,800 - $286,200
Actual salary offers are determined at hire and may vary by location. This role is eligible for performance based incentive compensation, which may include cash bonuses and long term incentives. Capital One provides a comprehensive package of health, financial, and other benefits that support total well being. Eligibility varies based on full or part time status, exempt or non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days.
Additional Information
Capital One is an equal opportunity employer (EOE, including disability/vet) and promotes a drug-free workplace.
Similar Jobs