Senior Machine Learning Engineer, Data Infrastructure
Job Description
Unity Technologies SF is hiring a Senior Machine Learning Engineer to help design and evolve a large-scale offline data platform used to generate training datasets and run end-to-end data workflows. In this onsite role in Mountain View, you will build reliable batch and stream infrastructure, strengthen reproducibility and observability, and collaborate closely with ML teams to support scalable, cost-efficient production machine learning.
What you will do
- Develop infrastructure for batch and stream big data processing using technologies such as Flink, Spark, and Ray.
- Design and operate large-scale data pipelines that produce training datasets for machine learning training and experimentation.
- Integrate pipelines with workflow orchestration systems such as Flyte, Airflow, or similar tools to support reliable multi-stage training workflows.
- Improve reproducibility and observability through dataset validation, monitoring, and automated testing.
- Optimize performance and resource utilization across distributed compute systems used for data processing.
- Partner with ML engineers to enable efficient large-scale experimentation and iterative model development.
- Lead architectural improvements to keep offline data pipelines scalable, reliable, and cost-efficient.
What you bring
- Experience working with distributed computing frameworks such as Flink, Spark, and Ray for distributed data processing.
- Experience building infrastructure for training data generation, dataset preparation, or ML feature pipelines.
- Background optimizing big data pipelines and infrastructure for cost efficiency.
- Strong Python programming skills with experience on large-scale distributed workloads.
- Experience with modern data infrastructure including data lakes, warehouses, orchestration systems, and streaming platforms.
- Strong systems thinking to evaluate performance, scalability, reliability, and cost tradeoffs in distributed systems.
- Demonstrated ability to lead technical direction and influence architectural decisions across teams without formal authority.
Technologies
- Flink
- Spark
- Ray
- Flyte
- Airflow
- Python
Compensation
USD 165,600 - 273,400 per year.
Benefits
- Comprehensive health, life, and disability insurance
- Commute subsidy
- Employee stock ownership
- Competitive retirement/pension plans
- Generous vacation and personal days
- Support for new parents through leave and family-care programs
- Office food snacks
- Mental Health and Wellbeing programs and support
- Employee Resource Groups
- Global Employee Assistance Program
- Training and development programs
- Volunteering and donation matching program
- Equity awards
- Participation in company incentive plans (such as annual discretionary bonuses or sales commissions)
Note: Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.