Machine Learning Engineer 4 - Manager IC
Job Description
Build and scale enterprise machine learning platforms on Capital One’s Enterprise ML Platform team. In this Machine Learning Engineer 4 (Manager IC) role, you will help evolve a high-throughput, multi-tenant training platform and own Kubeflow Pipelines v2 on Amazon EKS. You will also support responsible, governable AI in real engineering workflows, with a focus on stability, security, and enterprise readiness.
What you’ll do
- Design, build, and deliver ML models and supporting components for real business use cases in partnership with Product and Data Science
- Guide ML infrastructure decisions using expertise across modeling and training topics, including model and feature selection, hyperparameter tuning, dimensionality, bias/variance, and validation
- Solve complex problems through application code, model development and validation, and automation of tests and deployment
- Collaborate on a cross-functional Agile team to create and enhance software for state-of-the-art big data and ML applications
- Retrain, maintain, and monitor models in production to support ongoing performance
- Leverage and/or build cloud-based architectures, technologies, and platforms to deliver optimized ML at scale
- Construct optimized data pipelines to power ML models
- Apply CI/CD best practices, including test automation and monitoring, to support successful deployments
- Ensure code quality to reduce vulnerabilities and support risk-governed model use, following Responsible and Explainable AI best practices
- Work with languages such as Python, Scala, or Java
Required qualifications
- Bachelor’s Degree or higher in Computer Science, Machine Learning, or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 4 years of programming experience with Python, Java, Golang, or C++
- At least 4 years of Machine Learning experience using industry standard frameworks PyTorch or Tensorflow and libraries including Pandas, NumPy, Scikit-learn
- At least 4 years using and operating large-scale distributed systems such as Spark and Ray to prepare AI or ML data
- At least 2 years deploying and operating ML solutions in production and operating production services in the cloud (AWS, GCP, Azure), using Kubernetes to manage large-scale containerized ML systems
Preferred qualifications
- Master’s or Doctoral Degree in Computer Science, Electrical Engineering, Mathematics, or a related field
- 3+ years designing, training, optimizing, and evaluating modern ML models across architectures (e.g., Transformers, CNNs, RNNs) and paradigms (supervised, unsupervised, reinforcement learning), including loss design, hyperparameter tuning, and diagnostic debugging
- 3+ years architecting and scaling distributed, end-to-end ML systems from production-ready training/evaluation data pipelines through algorithm and infrastructure optimization
- 3+ years managing ML workloads using Docker, Kubernetes, and pipeline orchestration tools (with Kubeflow as a strong plus)
- 3+ years applying modern software best practices (CI/CD, version control, automated testing, code reviews) and deploying resilient systems with progressive rollout strategies (blue/green, canary/one-box), plus monitoring, alerting, and incident response planning
- 1+ years experience as a technical lead developing ML solutions using industry best practices, patterns, and automation
- Authored/co-authored a paper on an ML technique, model, or proof of concept
Technologies you may work with
Python, Scala, Java, Golang, C++, PyTorch, Tensorflow, Pandas, NumPy, Scikit-learn, Spark, Ray, Kubeflow Pipelines v2, Amazon EKS, Kubernetes, AWS, GCP, Azure, Docker, CI/CD, blue/green, canary, progressive rollout, Transformers, CNNs, RNNs, supervised learning, unsupervised learning, reinforcement learning.
Compensation and location
Location: New York, NY (onsite)
Salary: USD 215,200 - 245,600 per year.
This role may also be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long-term incentives (LTI).
Capital One does not sponsor new applicants for employment authorization or provide immigration-related support for this position.
Benefits
Comprehensive, competitive, and inclusive set of health, financial, and other benefits.
Additional details
- Expected to accept applications for a minimum of 5 business days
- No agencies
- Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
- Capital One promotes a drug-free workplace
- Accommodation and recruiting contact: 1-800-304-9102 or [email protected]; for recruiting process questions: [email protected]