Position: Senior MLOps Engineer focused on the Recommendation Engine, collaborating with Data Scientists to design and deploy ML models on a modern MLOps stack. This role is based in New York, NY 10001. You will lead the development and maintenance of pipelines for distributed training on large compute clusters, real-time and batch model serving, scale-out hyperparameter tuning, model monitoring, and production validation within a structured, controlled environment. The Personalization and Insights product area builds high-throughput, low-latency applications deployed on AWS, delivering personalized experiences across Chase Consumer & Community Banking channels and integrating services in Travel, Merchant Offer Shopping and Dining spaces.
Job responsibilities
- Build, deploy, and maintain robust pipelines for distributed training on GPU-enabled clusters to support scalable machine learning workflows.
- Develop and manage pipelines for high-throughput, real-time inference as well as batch inference, ensuring optimal performance and reliability.
- Implement quantization techniques and deploy large language models to maximize efficiency and resource utilization.
- Oversee the management and optimization of vector databases to support advanced AI and machine learning applications.
- Establish and maintain comprehensive monitoring and observability pipelines to ensure system health, performance, and rapid issue resolution.
- Collaborate with cross-functional teams to integrate new technologies and continuously improve existing infrastructure.
- Partner with product, architecture, and other engineering teams to define scalable and performant technical solutions.
Required qualifications, capabilities, and skills
- BS in Computer Science or related Engineering field with 6+ years of experience or MS degree with 4+ years of experience.
- Strong experience in Python and cloud computing, preferably AWS.
- Understanding of quantization techniques such as PTQ, AWQ used to quantize LLMs for accelerated inference on specific GPU architectures.
- Experience in systems engineering fundamentals including caching, CUDA, autoscaling, high throughput, low latency, and multi-region resilience.
- Deep knowledge of data science fundamentals, training and deploying models.
- Experience with monitoring and observability tools to track model input/output and feature statistics.
- Operational experience with big data/ML tools such as Ray, DuckDB, Spark, and training/inference systems like Ray, vllm/SGLang.
- Solid grounding in engineering fundamentals and an analytical mindset.
Preferred qualifications, capabilities, and skills
- Experience with recommendation and personalization systems is a plus.
- CUDA expertise is highly desirable.
- Solid fundamentals and experience with containers (Docker), container orchestration (Kubernetes, ECS), and DAG orchestration (Airflow, Kubeflow, etc).
- Good knowledge of databases.
Compensation and benefits
We offer a competitive total rewards package, with base salary determined by role, experience, skill set, and location. Eligible employees may receive commission-based pay and/or discretionary incentive compensation in cash and/or eligible equity, based on individual achievements and contributions. A comprehensive benefits program is available, including health care coverage, on-site wellness facilities, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Specific details about compensation and benefits will be provided during the hiring process.
About Us
JPMorganChase is one of the oldest financial institutions, delivering innovative financial solutions to millions of consumers, small businesses and many of the world's leading corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans more than 200 years, and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.
About the Team
J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions worldwide entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.