Senior Machine Learning Engineer, Conversational AI - Services Special Projects
Job Description
Apple is building real-time conversational experiences, and this Senior Machine Learning Engineer role supports services special projects tied to conversational AI. In this onsite position in Cupertino, you will help own the conversational intelligence layer, from agent reasoning and tool-calling to low-latency LLM inference and knowledge services that keep answers accurate and grounded.
What you will do
- Design multi-turn conversational experiences for real-world use cases.
- Build agent logic that plans, calls tools, and supports tool-enabled conversations.
- Develop query understanding models that convert natural language into structured intent.
- Make large and smaller models fast and cost-efficient enough for real-time serving.
- Support accuracy and grounding so responses remain reliable.
- Build and scale knowledge graph services to resolve, enrich, and expand user requests with low latency.
- Connect the system to real-time data sources so answers stay current.
- Create automated evaluation, including LLM-as-judge for multi-turn conversations, integrated into the development workflow.
Required qualifications
- Master’s degree in Computer Science, Machine Learning, NLP, or a related field.
- 7+ years of experience as a software or machine learning engineer, with a significant focus on conversational AI, search, or LLM-powered systems.
- Strong programming skills in Go and Python**, plus at least one of Java or Scala.
- Hands-on experience building and shipping conversational AI or dialogue systems, including intent and slot understanding, multi-turn context management, clarification, and disambiguation.
- Production experience with LLM-powered applications, including prompt design, tool/function calling, structured output generation, and agentic orchestration patterns.
- Proven experience optimizing LLM inference, such as distillation, quantization, batching, KV-cache tuning, caching, and profiling to identify bottlenecks.
- Hands-on experience deploying and serving LLMs or ML models in the production request path using serving frameworks such as vLLM, SGLang, Triton, or TorchServe.
- Experience with knowledge graphs and low-latency lookup and retrieval services.
- Fluency with PyTorch and the Hugging Face ecosystem (transformers, PEFT).
- Familiarity with cloud environments (including AWS) and containerization (Docker, Kubernetes).
- Excellent communication skills and a collaborative mindset.
Compensation and location
- Location: Cupertino, CA (onsite)
- Salary: USD 184,700 - 324,800 per year
Technologies you may work with
- Go, Python, Java, Scala
- PyTorch, Hugging Face (transformers, PEFT)
- Serving: vLLM, SGLang, Triton, TorchServe
- Cloud and deployment: AWS, Docker, Kubernetes
- Performance and serving: KV-cache tuning
- Data stores and graph systems: Cassandra, Redis, SSTables, TigerGraph, Neo4j
- Model fine-tuning: LoRA, adapters
- Experiment tracking and versioning: MLflow, Weights & Biases, DVC
Benefits
- Comprehensive medical and dental coverage
- Retirement benefits
- Discounted products and free services
- Reimbursement for certain educational expenses, including tuition
- Discretionary bonuses or commission payments may apply, and relocation may be eligible
- Participation in Apple’s discretionary employee stock programs may allow Apple employees to become shareholders
- Eligible discretionary restricted stock unit awards
- Option to purchase Apple stock at a discount through the Employee Stock Purchase Plan
Preferred qualifications
- Ph.D. in Computer Science, Machine Learning, NLP, or a related field
- Experience fine-tuning and distilling LLMs for task-specific use (for example, query parsing, classification, response generation) using techniques such as LoRA/adapters and teacher/student setups
- Experience designing knowledge graph schemas, building graph compilation and ingestion pipelines, and working with graph databases such as TigerGraph or Neo4j
- Deep experience with KV stores and in-memory serving for low-latency lookups (such as Cassandra, Redis, SSTables)
- Experience calibrating LLM judges against human judgments for multi-turn conversations, including inter-annotator agreement and judge reliability tracking
- Experience with personalization and memory in conversational systems, applying privacy principles such as data minimization and on-device processing
- Experience implementing safety guardrails for LLM-powered agents, including prompt-injection defenses and adversarial evaluation
- Familiarity with experiment tracking and data/model versioning tools (MLflow, Weights & Biases, DVC)
- Deep understanding of distributed systems and service design, including architecting and leading projects with cross-functional stakeholders
- Published work or patents in conversational AI, information retrieval, knowledge graphs, or efficient inference
Similar Jobs
F