DataJobs.io
← Back to all jobs

Job Description

Work as a Sr. Machine Learning Engineer on Amazon Ads’ Ad Response Prediction team, shaping ML infrastructure and architecture for ad relevance across training, real-time inference, and LLM-based GenAI workloads in New York, NY (onsite).

Responsibilities

  • Lead development of LLM inference infrastructure for next-generation GenAI workloads at Amazon Ads scale, including defining technical strategy, evaluating tradeoffs, and delivering production-ready solutions
  • Own architectural direction for large-scale ML training and real-time inference systems, driving scalability, automation, and efficiency improvements across the organization
  • Partner with applied scientists to design and optimize end-to-end ML pipelines, covering model training and evaluation through deployment and serving at massive scale
  • Establish ML infrastructure best practices and contribute to cross-team architectural decisions to influence technical direction beyond your immediate team
  • Make principled tradeoff decisions for complex, ambiguous problems in a fast-moving GenAI environment, delivering results independently
  • Mentor engineers across the team and serve as a technical resource for ML infrastructure expertise

Requirements

  • 5+ years of non-internship professional software development experience
  • 5+ years of programming experience with at least one software programming language
  • 5+ years leading design or architecture work, including design patterns, reliability, and scaling of new and existing systems
  • Experience as a mentor, tech lead, or leading an engineering team
  • 5+ years of full software development life cycle experience, including coding standards, code reviews, source control management, build processes, testing, and operations
  • Bachelor's degree in computer science or equivalent

Compensation

  • USD 193,300 - 227,400 per year

Benefits

  • Comprehensive benefits, including health insurance (medical, dental, vision, prescription), Basic Life & AD&D insurance, and option for Supplemental life plans
  • EAP, Mental Health Support, Medical Advice Line
  • Flexible Spending Accounts
  • Adoption and Surrogacy Reimbursement coverage
  • 401(k) matching
  • Paid time off
  • Parental leave
  • Sign-on payments
  • Restricted stock units (RSUs)

Similar Jobs