Storm3 is seeking a Staff Applied AI Engineer in New York, NY to lead the technical direction of AI systems supporting pharmaceutical marketing. The role focuses on end-to-end ML and evaluation, including retrieval, generation, verification, attribution, and production MLOps for regulated use cases.

Responsibilities

Own the retrieval, generation, verification, and evaluation workflow for AI-generated pharmaceutical marketing assets, including emails, banners, slides, and leave-behinds.
Build claim-level attribution so that each sentence in generated output can be traced to a specific, defensible source across proprietary corpora, including prescribing information, clinical data, approved assets, style guides, and claim libraries.
Develop offline evaluation metrics that predict downstream MLR review outcomes, where ground truth becomes available slowly and may include inconsistent reviewer redlines.
Connect generated content to real-world performance by tracking engagement, HCP responses, and scripts written, then feeding those signals back into the system.
Run full ML ops, including CI/CD for ML, versioning, automated testing, monitoring, and behavioral regression detection.
Deliver high-craft output with strong visual and textual quality that remains intact through generation rather than being silently rewritten.

Requirements

Deep production experience shipping, operating, and maintaining ML/LLM systems.
An evaluation mindset, including a history of inventing metrics to measure and improve system performance.
Strong LLM depth across retrieval, agentic pipelines, targeted fine-tuning, and selecting the right tool for each task.
Full-stack capability with Python, FastAPI, Docker, and AWS, with the ability to move from research to deployed service independently.
Comfort making confident decisions under ambiguity and iterating quickly as conditions change.
A direct, open communication style.

Technologies

Python
FastAPI
Docker
AWS
CI/CD

Benefits

Competitive NYC compensation
Relocation support
Visa sponsorship: O-1, H-1B, TN
Unlimited PTO
401(k) with 4% match
In-office lunches
Ground-floor equity

Compensation and Location

Location: New York, NY (onsite)
Salary: USD 230,000 - 350,000 per year

Why Apply

This is a ground-floor role with real architectural ownership at a fast-growing startup working with 50+ pharmaceutical brands. The work involves difficult, unsolved technical challenges across provenance-preserving generation, slow ground-truth evaluation, and regulated AI deployment, with top-tier backing, ground-floor equity, and influence over product and hiring from day one.

Staff Applied AI Engineer

Job Description