DataJobs.io
← Back to all jobs

Job Description

Robotics Technologies is hiring a Senior AI Engineer to design, develop, and operationalize agentic AI applications that support Firm Risk Management in a governed enterprise environment. The role centers on building reliable LangGraph-based agent workflows, strengthening context and memory, and establishing evaluation and observability practices that make failures easier to trace and improve.

This position is located in New York, NY and is onsite. Compensation is listed as USD 90 per hour.

Responsibilities

  • Design and build modular, maintainable Python applications, APIs, and services that integrate LLMs, enterprise data, and business tools.
  • Develop LangGraph agent workflows with explicit state, conditional routing, tool execution, checkpointing, and human-in-the-loop approval or escalation where appropriate.
  • Engineer agent context by selecting and assembling relevant instructions, retrieved information, tool outputs, and conversation history within token and access-control constraints.
  • Design, version, and test prompts, including structured outputs, grounding instructions, and safe handling of incomplete or conflicting information.
  • Implement short- and long-term memory strategies, including persistence, retrieval, summarization, retention, and isolation between users and sessions.
  • Build evaluation frameworks using representative datasets, repeatable regression tests, and automated plus human evaluation.
  • Assess answer quality, grounding, tool-call correctness, task completion, and failure behavior.
  • Implement LLM and agent observability using Galileo or comparable platforms, including execution traces, quality signals, latency, token usage, cost, and failure analysis.
  • Apply guardrails for prompt injection, unsafe tool use, sensitive-data exposure, and unsupported outputs, including access controls and auditable execution paths.
  • Collaborate with risk specialists, product owners, data engineers, and platform teams to translate requirements into tested applications, supporting deployment and troubleshooting.
  • Participate in technical design reviews, code reviews, documentation, and engineering guidance while continuing to contribute directly through coding.

Requirements

  • Strong hands-on Python software engineering, including application design, asynchronous programming, APIs, automated testing, error handling, and maintainable code.
  • Proven experience implementing AI agents with LangGraph with stateful orchestration and real integrations with external tools or services, not limited to chatbots, tutorials, or conceptual designs.
  • Practical understanding of LLMs, embeddings, retrieval-augmented generation (RAG), vector search, and retrieval context tradeoffs.
  • Hands-on experience with context engineering, prompt engineering, and agent memory management.
  • Experience designing and implementing evaluation frameworks for LLMs or agent applications, including test-set construction and interpreting evaluation results.
  • Experience with Galileo or a comparable LLM or agent evaluation and observability platform, including tracing failures and using findings to improve applications.
  • Experience delivering and supporting deployed applications, with sound knowledge of security, reliability, version control, CI/CD, and production troubleshooting.
  • Ability to explain technical decisions, clarify individual contributions versus team outcomes, and collaborate effectively with business and engineering stakeholders.

Technologies

  • Python, LangGraph, LLMs, embeddings, retrieval-augmented generation (RAG), vector search, Galileo
  • Snowflake, Databricks, Model Context Protocol (MCP), GitHub Copilot, Claude Code, Amp
  • CI/CD, containers

Highly Desirable

  • Knowledge of Model Risk Management, model development and validation lifecycles, model documentation, governance, or model monitoring.
  • Experience with broader risk management, especially credit risk, market risk, or financial-services risk workflows.
  • Experience with Snowflake, Databricks, lakehouse architectures, enterprise data pipelines, or governed knowledge integration.
  • Familiarity with Model Context Protocol (MCP), cloud deployment, containers, and enterprise identity and access controls.
  • Prior experience using AI coding assistants such as GitHub Copilot, Claude Code, or Amp, with disciplined review, testing, and secure handling of code and data.

Similar Jobs