Applied AI Engineer
Job Description
Applied AI Engineer role focused on designing, building, deploying, and continuously improving secure AI-enabled applications.
Responsibilities
- Build AI-enabled application capabilities, Python services, and APIs for assistants, semantic search, decision support, and other approved business workflows.
- Develop retrieval-augmented generation solutions using enterprise knowledge, embeddings, search, document processing, and access-aware indexing for relevant, grounded responses.
- Implement bounded agent and tool-calling workflows with validated permissions, output controls, failure handling, and human review for consequential actions.
- Create representative evaluation datasets, task-specific acceptance criteria, and automated regression tests to measure quality, grounding, task completion, and failure behavior.
- Maintain maintainable production services using version control, automated testing, code review, CI/CD, deployment, rollback, monitoring, and support practices.
- Apply approved security and responsible AI controls for sensitive-data handling, access permissions, prompt-injection defenses, and validation of model outputs and tool actions.
- Monitor production quality, reliability, latency, and cost; continuously improve prompts, retrieval, model selection, orchestration, and fine-tuning when supported by evidence.
- Partner transparently with product, business, architecture, platform, data, and delivery teams to validate feasibility, deliver iteratively, document decisions, and share reusable AI practices.
- Perform other duties as assigned.
Requirements
- Typically requires a bachelor’s degree and 10+ years of experience in a related field, or MS/MA and generally 8+ years of experience in a related field.
- Maintain expert knowledge in the area of responsibility with a strong understanding of adjacent areas to develop creative solutions.
- Bachelor’s degree in Computer Science, Software Engineering, Data Science, or a related field.
- 5 years of software engineering experience, including at least two years building AI, machine learning, or generative AI solutions.
- Experience deploying and supporting AI-enabled applications in production, including Python, REST APIs, cloud services, automated testing, CI/CD, monitoring, and troubleshooting.
- Hands-on knowledge of LLM integration, retrieval-augmented generation, embeddings, retrieval quality, evaluation methods, secure data access, validation, fallback behavior, and appropriate human oversight.
- Clear communication of technical tradeoffs and dependable collaboration across business and technical teams in an iterative delivery environment.
- Use multiple commercial or open-weight model ecosystems and AI orchestration, retrieval, vector search, or re-ranking frameworks.
- Experience with enterprise AI development and operations platforms and cloud environments such as Microsoft Foundry, MLflow, Databricks, Azure, AWS, or Google Cloud.
- Apply model fine-tuning, traditional machine learning, or advanced agent evaluation when supported by a defined business need.
- Experience applying AI to distribution, B2B commerce, sales, customer service, or associate workflows.
Technologies
- Python
- REST APIs
- CI/CD
- Embeddings
- Retrieval-augmented generation
- LLM integration
- Vector search
- Re-ranking
- Microsoft Foundry
- MLflow
- Databricks
- Azure
- AWS
- Google Cloud
- Fine-tuning
- Machine learning
Nature and Scope
- Consults with senior management on solution development for complex strategic and technical business issues.
- Independently solves unique and complex problems with broad business impact.
- Establishes operational plans for assigned area.
- Acts as a strategic advisor and contributes expert skills to development of strategic company objectives.
- Receives general administrative and business direction as needed.
- Guides and mentors staff at all levels; provides advice to senior management on complex and strategic issues; may lead or manage complex projects with dotted line responsibility.
Work Environment
- Comfortable indoor area.
- Overnight travel typically less than 10% of the time.