Sr. AI Engineer (Full Stack)

Peloton is seeking a Sr. AI Engineer to deliver production-grade AI applications and the architecture layers that connect autonomous agents into Peloton’s enterprise infrastructure. The role emphasizes fast shipping, AI memory and state solutions, enterprise data integration, and evaluation-driven inference cost optimization.

Responsibilities

• Convert ambiguous problems into functional, high-performing AI features and standalone tools.
• Solve the “State Problem” for AI by designing memory architectures and vector stores that maintain context while strictly following data retention and deletion policies, using Pinecone and pgvector.
• Build data pipelines and entity-resolution logic that connect information across CRM, ERP, CPQ, and marketing systems into a single reliable source of truth for agent actions (including Salesforce, SAP, BigQuery).
• Work with Peloton business units to understand workflows, identify high-value opportunities, and select initial use cases to demonstrate value.
• Partner closely with stakeholder teams to understand requirements and guide adoption of what is built.
• Provide field feedback that informs other teams about model performance, including where improvements are needed.
• Implement continuous evaluation pipelines to test for hallucinations, prompt injections, data leakage, and performance regressions before production deployment.
• Apply Semantic Caching and smart routing logic to direct routine queries to smaller, lower-cost models, supporting low latency and efficient inference costs.

Requirements

• 5–7+ years of general software engineering experience.
• Strong foundational software engineering skills including distributed systems, asynchronous patterns, API design, microservices, and databases.
• Ability to pivot to the language or framework that delivers results fastest.
• Hands-on experience deploying RAG (Retrieval-Augmented Generation) and Agentic Workflows into production using LLM APIs, vector databases, and orchestration frameworks.
• Demonstrated experience building and maintaining pipelines across fragmented enterprise systems (CRM, ERP, CPQ, marketing platforms), with focus on entity resolution, schema design, and data quality.
• Experience working with cutting-edge AI ecosystem tooling and compute resources.
• Evidence that shipped work can reach real users quickly, in days rather than months.

Technologies

• Pinecone
• pgvector
• Salesforce
• SAP
• BigQuery
• RAG (Retrieval-Augmented Generation)
• LLM APIs

Compensation and Location

Location: New York, NY (hybrid).
Salary: USD 160,600 - 224,950 per year.

About the Role

Peloton is looking for a scrappy, creative, and fast-moving AI engineer who can take raw ideas and rapidly transform them into production-grade applications for a global organization. The work includes architecting Intelligence and Integration layers that connect autonomous agents directly into Peloton’s enterprise infrastructure. The team emphasizes systems thinking, engineering fundamentals, product sense, and the ability to ship quickly, with outcomes that reach real users in days. The role also involves building within the bleeding edge of the AI ecosystem using top-tier tools and compute resources.