Staff Machine Learning Engineer
Job Description
The Staff Machine Learning Engineer role on the Data Science Team provides technical leadership for large-scale AI/ML services and production machine learning systems. You will help shape the end-to-end architecture and engineering practices behind globally deployed models used across open web, social, video, and mobile applications.
Responsibilities
- Lead the architectural vision and system design for core AI/ML-based services.
- Serve as technical lead for complex, multi-quarter initiatives, from inception through global deployment.
- Design and build large-scale deep learning infrastructure and platforms for distributed model training, focused on low latency and high availability at enterprise scale.
- Collaborate with Product Management, Core Engineering, and executive stakeholders to align ML capabilities with business strategy.
- Convert high-level product requirements into concrete technical designs.
- Mentor and guide senior and mid-level data scientists and engineers.
- Define standard methodologies, establish code quality expectations, and lead architecture design reviews.
- Work with large-scale AI training infrastructure components including accelerators, network fabrics, CUDA, NCCL, and RDMA, as well as big data ecosystems such as Databricks, Spark, Kubernetes, Kafka, and Prometheus.
- Design, develop, and support robust CI/CD pipelines for AI/ML services to help models move from research into reliable production endpoints.
Requirements
- PhD or Master’s degree in a technical field such as computer science, mathematics, statistics, or equivalent years of experience.
- 7+ years of machine learning experience in industry, with a demonstrated history of operating at the Lead, Principal, or Staff level.
- Deep expertise building complex machine learning systems, including ranking infrastructure and data pipelines that support massive throughput.
- Production-hardened experience with frameworks including PyTorch, JAX, or TensorFlow.
- Strong production-grade programming skills in Python, Go, Java, or C++, with a deep understanding of software design principles and algorithms.
- Proven ability to work effectively in ambiguity, take large unstructured problems, and drive them to successful technical resolution.
- A strong track record of collaborating with, elevating, and mentoring engineering talent.
Technology Stack
- PyTorch, JAX, TensorFlow
- Python, Go, Java, C++
- CUDA, NCCL, RDMA
- Databricks, Spark, Kubernetes, Kafka, Prometheus
Benefits
- Paid time off
- Health insurance (medical, dental, vision)
- PPO, HSA and FSA options
- 401k with employer matching contributions
- Annual bonus and/or other incentive plans
Compensation and Location
Salary: USD 135,100 to 231,600 per year. Location: New York, NY (remote).