DataJobs.io
← Back to all jobs

Job Description

The Staff Machine Learning Engineer role on the Data Science Team provides technical leadership for large-scale AI/ML services and production machine learning systems. You will help shape the end-to-end architecture and engineering practices behind globally deployed models used across open web, social, video, and mobile applications.

Responsibilities

  • Lead the architectural vision and system design for core AI/ML-based services.
  • Serve as technical lead for complex, multi-quarter initiatives, from inception through global deployment.
  • Design and build large-scale deep learning infrastructure and platforms for distributed model training, focused on low latency and high availability at enterprise scale.
  • Collaborate with Product Management, Core Engineering, and executive stakeholders to align ML capabilities with business strategy.
  • Convert high-level product requirements into concrete technical designs.
  • Mentor and guide senior and mid-level data scientists and engineers.
  • Define standard methodologies, establish code quality expectations, and lead architecture design reviews.
  • Work with large-scale AI training infrastructure components including accelerators, network fabrics, CUDA, NCCL, and RDMA, as well as big data ecosystems such as Databricks, Spark, Kubernetes, Kafka, and Prometheus.
  • Design, develop, and support robust CI/CD pipelines for AI/ML services to help models move from research into reliable production endpoints.

Requirements

  • PhD or Master’s degree in a technical field such as computer science, mathematics, statistics, or equivalent years of experience.
  • 7+ years of machine learning experience in industry, with a demonstrated history of operating at the Lead, Principal, or Staff level.
  • Deep expertise building complex machine learning systems, including ranking infrastructure and data pipelines that support massive throughput.
  • Production-hardened experience with frameworks including PyTorch, JAX, or TensorFlow.
  • Strong production-grade programming skills in Python, Go, Java, or C++, with a deep understanding of software design principles and algorithms.
  • Proven ability to work effectively in ambiguity, take large unstructured problems, and drive them to successful technical resolution.
  • A strong track record of collaborating with, elevating, and mentoring engineering talent.

Technology Stack

  • PyTorch, JAX, TensorFlow
  • Python, Go, Java, C++
  • CUDA, NCCL, RDMA
  • Databricks, Spark, Kubernetes, Kafka, Prometheus

Benefits

  • Paid time off
  • Health insurance (medical, dental, vision)
  • PPO, HSA and FSA options
  • 401k with employer matching contributions
  • Annual bonus and/or other incentive plans

Compensation and Location

Salary: USD 135,100 to 231,600 per year. Location: New York, NY (remote).

Similar Jobs