Lead Machine Learning Engineer

ADP seeks a Lead Machine Learning Engineer in New York, NY (onsite) with a salary range of USD 134,423 - 190,200 per year to design and implement LLM-powered solutions and provide technical leadership across engineering teams.

Responsibilities

• Lead the design and architecture of large language model solutions for complex business problems, with a primary focus on automating client onboarding.
• Collaborate with implementation teams to identify gaps in current product features and design scalable LLM-powered solutions to address those gaps.
• Partner with Technical Product Managers to develop and prioritize product roadmaps that deliver strategic enhancements and drive business value.
• Design and implement high-performance LLM applications and systems using LangChain, LlamaIndex, and foundation models such as GPT-4, Claude, and Llama.
• Develop and maintain scalable LLMOps pipelines including prompt engineering, fine-tuning, evaluation frameworks, and monitoring systems.
• Implement retrieval-augmented generation architectures and vector databases for enhanced model performance.
• Evaluate model performance through systematic testing, A/B testing, and observability tools, identifying areas for optimization and improvement.
• Collaborate with data scientists, software engineers, product managers, and implementation teams to translate business requirements into LLM-powered technical solutions.
• Work closely with software engineers to integrate LLM applications into product architecture, ensuring deployment, maintenance, and monitoring via comprehensive LLMOps practices.
• Provide technical leadership and mentorship to engineering teams, documenting and communicating design decisions and best practices to stakeholders across the organization.
• Drive innovation by staying current with the latest advances in LLMs, generative AI, and prompt engineering techniques, applying emerging technologies to business challenges.
• Build and maintain robust LLMOps infrastructure using modern development tools, including Docker/Kubernetes, CI/CD pipelines with Jenkins and Ansible, and cloud platforms such as AWS or Azure.
• Develop RESTful APIs and GraphQL services to enable seamless integration of LLM capabilities into existing systems.
• Implement observability and monitoring solutions for LLM applications, including token usage tracking, latency optimization, and cost management.

Requirements

• A Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or a related field plus five years of related experience; or a Master’s degree with three years of related experience.
• Three years of experience must include Python; LLMs and foundation models (GPT-4, Claude, or Llama); LLM frameworks (LangChain, LlamaIndex, or similar); Prompt engineering and fine-tuning techniques; Vector databases (Pinecone, Weaviate, or ChromaDB); RESTful APIs; Go or Node.js technologies; RDBMS and NoSQL databases (MySQL or DynamoDB); Public Cloud (AWS or Azure); Docker and Kubernetes; Git; CI/CD pipelines (Jenkins and Ansible); GraphQL; and Agile methodologies.

Technologies

• Python
• Go
• Node.js
• MySQL
• DynamoDB
• Docker
• Kubernetes
• Git
• Jenkins
• Ansible
• AWS
• Azure
• LangChain
• LlamaIndex
• GPT-4
• Claude
• Llama
• Pinecone
• Weaviate
• ChromaDB
• RESTful APIs
• GraphQL

Benefits

• Medical
• Dental
• Vision
• Life Insurance
• Matched Retirement Savings
• Wellness Program
• Short- and Long-Term Disability
• Charitable Contribution Match
• Holidays
• Personal Days & Vacation
• Paid Volunteer Time Off