Genai Inference Data Jobs

1 job found

1d ago

Capital One New York, NY

New York, NY

1d ago

$215k - $246k/yr Full time Ai Governance Ai Ml Ai Observability

Capital One is hiring a Lead AI Engineer to build responsible, reliable AI systems and LLM-enabled capabilities for production use.

Partner with cross-functional teams across engineering, research science, technical program management, and product management to deliver AI-powered products for associates and customers
Design, develop, test, deploy, and support AI software components, including:
- Foundation model training
- Large language model inference
- Similarity search
- Guardrails
- Model evaluation
- Experimentation
- Governance and observability
Apply Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and related tooling
Develop state-of-the-art LLM optimization techniques to improve production performance including scalability, cost, latency, and throughput
Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One

Bachelor’s or Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or a related field, plus:
- At least 4 years experience developing AI and ML algorithms or technologies, OR
- At least 2 years experience developing AI and ML algorithms or technologies
At least 4 years of programming experience with Python, Go, Scala, or Java

At least 6 years of experience deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
Experience designing, developing, delivering, and supporting AI services
Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, or Golang
Experience developing and applying state-of-the-art techniques for optimizing training and inference software to improve hardware utilization, latency, throughput, and cost
Interest in staying current with AI research and applying novel techniques judiciously in production

The Intelligent Foundations and Experiences (IFX) team brings Capital One’s AI vision to life
IFX partners across the company to advance science and AI engineering and deploy proprietary solutions central to the business
AI models and platforms help teams enhance products with responsible, scalable AI for high-leverage impact

Comprehensive, competitive, and inclusive health, financial, and other benefits supporting total well-being
Performance based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Capital One may consider sponsoring a new qualified applicant for employment authorization for this position
Application window: expected to accept applications for a minimum of 5 business days
No agencies please
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
Capital One promotes a drug-free workplace
Capital One will consider for employment qualified applicants with a criminal history consistent with applicable laws
Accommodation: contact Capital One Recruiting at 1-800-304-9102 or RecruitingAccommodation@capitalone.com
Recruiting process support: Careers@capitalone.com
Capital One does not provide, endorse, or guarantee third-party products, services, educational tools, or information on this site
Capital One Financial includes multiple entities; postings in other countries correspond to specific entities

New Genai Inference Data Jobs, daily.