AI Engineer
Job Description
Tiny Health is building production-grade AI systems that support both consumer and clinician-facing products. In this AI Engineer role (remote in Texas), you will design and scale end-to-end AI capabilities, spanning integration, deployment, and ongoing monitoring. Depending on experience, you may also shape the AI roadmap and mentor engineers as the team grows.
What you’ll do
- Design, build, and maintain production-grade AI systems and APIs that power company products.
- Integrate and fine-tune models such as LLMs, embeddings, or other ML architectures for customer-facing and internal use cases.
- Own the full lifecycle of AI features, from research and prototyping through productionization, deployment, and monitoring.
- Partner with engineering, product, and science teams to scope and ship AI-driven features.
- Build data pipelines, retrieval systems, and scalable infrastructure for inference and model serving.
- Deliver performance, observability, and reliability for AI components operating in production.
- (Depending on experience) Lead AI initiatives, guide architecture and system design decisions, and mentor other engineers.
What you bring
- Proven experience building and deploying AI or ML systems in production at scale, not only prototypes or demos.
- Deep understanding of model integration workflows, including inference pipelines, prompt engineering, fine-tuning, or RAG setups.
- A strong backend engineering foundation with Python or Node.js preferred.
- Experience designing AI architectures such as hybrid retrieval systems, multi-model orchestration, or embeddings-based approaches.
- Experience with AWS cloud infrastructure and data pipelines.
- Solid API development and system architecture skills for scalable applications.
- Comfort working independently and driving execution in a startup environment.
- Experience integrating LLMs into production products, including platforms such as OpenAI, Anthropic, or Vertex AI.
- Familiarity with vector databases including Pinecone, Weaviate, FAISS, or Chroma.
- Experience with observability, monitoring, and evaluation for AI systems.
- Experience leading projects or mentoring engineers.
- Prior experience in healthtech, biotech, or working with sensitive health data.
Technologies
- Python, Node.js
- LLMs, embeddings
- AWS
- API development
- Prompt engineering, fine-tuning
- RAG
- OpenAI, Anthropic, Vertex AI
- Pinecone, Weaviate, FAISS, Chroma
How the team works
Tiny Health is remote-first with overlapping hours across North America. Core hours run from 9am to 6pm CST, with flexibility to shift by up to two hours either way. Communication is written-first, with huddles used when threads stall and meetings reserved for real decisions.
The team moves fast without being sloppy, emphasizing shipping quality and treating rework as a cost of error. There is an expectation to shape what gets built, using a Day One mentality with fewer titles and layers, and process treated as a guardrail where it counts. Feedback and results are shared openly and in real time, and the bar is both high-performing and enjoyable.
Values
- Learn Fast, Get Better - Find root causes, not just fixes
- Be Relentlessly Resourceful - Move fast and know when to ask for help
- Act Like an Owner, Be Hungry to Win - Take responsibility for outcomes
- Act with Honesty and Empathy - Say what’s true with care
- Delight People by Anticipating Their Needs - Solve the problem and go further