Gpus Data Jobs

1 job found

Today

Capital One New York, NY

New York, NY

Today

$215k - $246k/yr Full time Agents Ai Ml Artificial Intelligence

Capital One is hiring an AI Engineer 4 in New York, NY (onsite) to build and deploy responsible, scalable AI systems for banking experiences.

Work with cross-functional teams (engineers, research scientists, technical program managers, and product managers) to deliver AI-powered products for associates and customers
Design, develop, test, deploy, and support AI software components, including:
- foundation model training
- large language model inference
- agents and multi-agent workflows
- similarity search
- guardrails
- model evaluation
- experimentation
- governance
- observability
Use open source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, and VectorDBs, along with PyTorch and other tools
Develop state-of-the-art foundation model optimization methods to improve production performance across scalability, cost, latency, and throughput
Help shape the technical vision and long-term roadmap for foundational AI systems at Capital One
Own end-to-end architecture for complex AI systems with focus on maintainability, observability, and ethical alignment
Define and maintain service-level objectives (SLOs) for AI reliability, covering latency, uptime, and model performance drift
Partner with infrastructure engineering to optimize GPU/TPU utilization and accelerate model inference pipelines
Lead cross-functional technical reviews for new AI deployments, ensuring security, data governance, and compliance standards are met
Mentor Principal and Senior Associates on scalable design, performance tuning, and translating research into production

Education + experience:
- Bachelor’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 4 years developing AI and ML algorithms or technologies; or
- Master’s degree in Computer Science, AI, Electrical Engineering, Computer Engineering, or related fields plus at least 2 years developing AI and ML algorithms or technologies
Programming: at least 4 years of experience with Python, Go, Scala, CUDA, or Java
AI/ML development: at least 4 years of experience developing AI and ML algorithms or technologies

Comprehensive, competitive, and inclusive set of health, financial, and other benefits supporting total well-being

Experience leading development of AI systems with tradeoffs among cost, latency, throughput, and accuracy
6+ years deploying scalable and responsible AI solutions on cloud platforms (e.g., AWS, Google Cloud, Azure, or equivalent private cloud)
Experience designing, developing, delivering, and supporting AI services
Experience developing AI and ML algorithms or technologies (e.g., LLM inference, similarity search and VectorDBs, guardrails, memory) using Python, C++, C#, Java, CUDA, or Golang
Experience building and applying state-of-the-art optimization techniques for training and inference to improve hardware utilization, latency, throughput, and cost
Experience building agentic AI systems and agentic workflows
Proficiency designing distributed systems for model training, evaluation, and online inference at petabyte scale
Experience defining AI model governance processes, including producibility, lineage tracking, and automated retaining schedules
Demonstrated ability to influence architectural decisions across multiple AI product lines or platforms

Salary: USD 215,200 - 245,600 per year

Location: New York, NY (onsite)

New Gpus Data Jobs, daily.