AI Engineer II
Job Description
Free Market Health is seeking an AI Engineer II (Embedded AI) in Pittsburgh, PA (onsite) to independently design, build, deploy, and continuously improve AI-enabled solutions. The role partners with business teams to turn moderately ambiguous needs into practical systems that deliver measurable value.
Responsibilities
- Develop a working understanding of the assigned business area’s workflows, systems, data, priorities, and operational challenges.
- Build trusted relationships with business users and stakeholders.
- Identify opportunities for AI, automation, and process improvement.
- Maintain and prioritize a pipeline of opportunities based on business value, feasibility, adoption potential, and risk.
- Translate moderately ambiguous business problems into appropriately scoped technical solutions.
- Drive solutions from implementation through user adoption, measurement, and continuous improvement.
- Define and track outcomes such as time saved, quality improvements, cost reductions, adoption, and operational impact.
- Independently design, build, test, deploy, and support production AI agents, applications, automations, and supporting services.
- Design agentic workflows connecting models, tools, enterprise data, APIs, and business applications.
- Build secure integrations using REST APIs, Model Context Protocol, and appropriate authentication and authorization methods.
- Implement and optimize LLM application patterns, including tool calling, structured outputs, retrieval-augmented generation, grounding, context management, and multi-step orchestration.
- Design retrieval solutions using structured and unstructured data, embeddings, vector search, and enterprise knowledge sources.
- Establish evaluation methods, testing standards, quality thresholds, observability, and failure-handling processes.
- Monitor production solutions for reliability, accuracy, usage, adoption, performance, and cost.
- Apply security, access controls, human oversight, and responsible AI governance throughout the solution lifecycle.
- Assess whether AI is appropriate versus conventional software, deterministic automation, data engineering, or process improvement.
- Contribute reusable architectures, components, engineering patterns, and technical documentation.
- Provide code reviews and informal technical guidance to earlier-career AI engineers.
Requirements
- At least 3 years of experience building and delivering software, automation, integrations, or production AI-enabled applications.
- Experience owning technical work from initial requirements or problem definition through production support.
- Demonstrated ability to troubleshoot, maintain, and improve production systems.
- Strong Python skills and working proficiency in SQL.
- Experience working with Databricks.
- Experience developing solutions on a major public cloud platform.
- Azure experience is preferred.
- Hands-on experience building and deploying LLM-powered applications or agentic systems.
- Experience with modern AI-assisted development environments, such as Cursor or Claude Code.
- Working knowledge of prompting, tool calling, RAG, structured outputs, agentic workflows, evaluation, and observability.
- Experience integrating enterprise systems through REST APIs and modern authentication methods.
- Familiarity with Model Context Protocol and emerging agent interoperability approaches.
- Strong software engineering practices, including source control, testing, code review, documentation, CI/CD, and production support.
- Ability to work independently with business users and stakeholders to understand operational challenges.
- Ability to turn moderately ambiguous business needs into practical technical approaches.
- Judgment on when AI is and is not the right solution.
- Ability to balance rapid delivery with reliability, security, maintainability, and governance.
- Ability to provide constructive technical feedback and guidance to less-experienced engineers.
Technologies
Python, SQL, Databricks, Azure, REST APIs, Model Context Protocol, LLM application patterns, tool calling, structured outputs, retrieval-augmented generation, grounding, context management, multi-step orchestration, embeddings, vector search, Cursor, Claude Code, CI/CD, LangGraph, LangChain, Azure AI Foundry, LLMOps
Benefits
- Unlimited PTO
- 100% employer-paid individual medical, dental, and vision premiums
- Employer HSA contribution
- Paid parental leave
- 401(k) match
- Transportation and parking benefits
- Flexible, collaborative work environment
Nice to Have
- Experience with Azure AI Foundry
- Production experience using LangGraph, LangChain, or comparable frameworks
- Experience developing or integrating Model Context Protocol servers
- Experience with agent evaluation, tracing, observability, or LLMOps
- Experience building enterprise RAG solutions using embeddings and vector search
- Experience implementing secure agent architectures with controlled tool access and appropriate human oversight
- Experience working with healthcare information, protected health information, or other regulated and sensitive data