DataJobs.io
← Back to all jobs

Job Description

Design and productionize AI assistants and multi-step agents for real enterprise workflows using Google Cloud Platform (GCP) and Vertex AI. In this onsite role in Hingham, MA, you will help build agentic experiences that combine LLM/agent development, grounded responses, and evaluation and monitoring in production.

What you’ll build

  • AI assistants on Vertex AI, covering model selection, prompt engineering, grounding, retrieval-augmented generation (RAG), and agent orchestration.
  • Multi-step AI agents using the Google Agent Development Kit (ADK), including agent architecture design with tool use, sub-agents, callbacks, and session management.
  • Applications that connect to Google Cloud AI/ML SDKs, including Vertex AI SDK for Python and Google Gen AI SDK, for programmatic foundation model access, embeddings, tuning, and prediction endpoints.
  • Agentic architectures using ADK orchestration patterns such as sequential, loop, parallel, and custom multi-agent hierarchies for multi-turn, multi-domain workflows.
  • Tool and function calling patterns within ADK agents that connect to enterprise APIs, databases, and external services for grounded, domain-specific responses.

How quality and safety are handled

  • Responsible AI practices including safety filters, bias detection, guardrails, hallucination mitigation, and content moderation.
  • Evaluation and monitoring frameworks to measure assistant quality, latency, cost, and user satisfaction in production, including ADK evaluation and tracing capabilities.

Platform and delivery

  • Architect scalable, production-grade solutions using Vertex AI Agent Builder, Vertex AI Search, Cloud Run, Cloud Functions, Pub/Sub, BigQuery, and other GCP services.
  • Collaborate with product managers, data engineers, and business stakeholders to translate requirements into AI-powered solutions.
  • Keep pace with the evolving AI landscape by evaluating emerging models, tools, and techniques and recommending adoption where appropriate.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field (or equivalent practical experience).
  • 5+ years of software engineering experience, with 2+ years focused on AI/ML or LLM-based agentic development.
  • Hands-on experience with GCP, particularly BigQuery, Cloud Storage, Cloud Run, or Cloud Functions.
  • Hands-on experience with Vertex AI Agent Builder, Vertex AI Search, or Dialogflow CX.
  • Hands-on experience with Google Cloud SDKs (Vertex AI SDK, Google Gen AI SDK) for model invocation, tuning, and deployment workflows.
  • Strong proficiency in Python and familiarity with ML/AI frameworks and libraries such as LangChain, LlamaIndex, TensorFlow, and PyTorch.
  • Experience building agentic LLM applications including prompt engineering, function calling, embeddings, and RAG.
  • Solid understanding of API design, microservices architecture, and cloud-native development patterns.
  • Familiarity with Git, CI/CD pipelines, and Infrastructure as Code such as Terraform and Cloud Build.

Compensation and benefits

  • Salary range: USD 140,310 - 171,490 per year
  • Paid time off
  • Medical/dental/vision insurance
  • 401(k)
  • Suite of well-being benefits to eligible employees

Preferred qualifications

  • Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Cloud Architect).
  • Exposure to multi-agent architectures, tool-use patterns, and agentic AI frameworks.
  • Experience with vector databases (e.g., Vertex AI Vector Search, AlloyDB, Pinecone, Weaviate) and embedding-based retrieval.
  • Knowledge of MLOps, including experiment tracking, model versioning, A/B testing, and monitoring in production.
  • Experience in regulated industries (healthcare, finance, insurance) with understanding of data privacy and compliance requirements.

Technologies you’ll work with

  • Google Cloud Platform (GCP), Vertex AI, Vertex AI Agent Builder, Vertex AI Search
  • Google Agent Development Kit (ADK), Vertex AI SDK for Python, Google Gen AI SDK
  • Cloud Run, Cloud Functions, Pub/Sub, BigQuery, Cloud Build, Terraform
  • Python, LangChain, LlamaIndex, TensorFlow, PyTorch, Dialogflow CX, Git

Time type: Full time. Location: Boston, Hingham. Education minimum: High school degree or equivalent required unless otherwise noted above.

Similar Jobs