AI Engineer
Job Description
Design and productionize AI assistants and multi-step agents for real enterprise workflows using Google Cloud Platform (GCP) and Vertex AI. In this onsite role in Hingham, MA, you will help build agentic experiences that combine LLM/agent development, grounded responses, and evaluation and monitoring in production.
What you’ll build
- AI assistants on Vertex AI, covering model selection, prompt engineering, grounding, retrieval-augmented generation (RAG), and agent orchestration.
- Multi-step AI agents using the Google Agent Development Kit (ADK), including agent architecture design with tool use, sub-agents, callbacks, and session management.
- Applications that connect to Google Cloud AI/ML SDKs, including Vertex AI SDK for Python and Google Gen AI SDK, for programmatic foundation model access, embeddings, tuning, and prediction endpoints.
- Agentic architectures using ADK orchestration patterns such as sequential, loop, parallel, and custom multi-agent hierarchies for multi-turn, multi-domain workflows.
- Tool and function calling patterns within ADK agents that connect to enterprise APIs, databases, and external services for grounded, domain-specific responses.
How quality and safety are handled
- Responsible AI practices including safety filters, bias detection, guardrails, hallucination mitigation, and content moderation.
- Evaluation and monitoring frameworks to measure assistant quality, latency, cost, and user satisfaction in production, including ADK evaluation and tracing capabilities.
Platform and delivery
- Architect scalable, production-grade solutions using Vertex AI Agent Builder, Vertex AI Search, Cloud Run, Cloud Functions, Pub/Sub, BigQuery, and other GCP services.
- Collaborate with product managers, data engineers, and business stakeholders to translate requirements into AI-powered solutions.
- Keep pace with the evolving AI landscape by evaluating emerging models, tools, and techniques and recommending adoption where appropriate.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Machine Learning, Data Science, or a related field (or equivalent practical experience).
- 5+ years of software engineering experience, with 2+ years focused on AI/ML or LLM-based agentic development.
- Hands-on experience with GCP, particularly BigQuery, Cloud Storage, Cloud Run, or Cloud Functions.
- Hands-on experience with Vertex AI Agent Builder, Vertex AI Search, or Dialogflow CX.
- Hands-on experience with Google Cloud SDKs (Vertex AI SDK, Google Gen AI SDK) for model invocation, tuning, and deployment workflows.
- Strong proficiency in Python and familiarity with ML/AI frameworks and libraries such as LangChain, LlamaIndex, TensorFlow, and PyTorch.
- Experience building agentic LLM applications including prompt engineering, function calling, embeddings, and RAG.
- Solid understanding of API design, microservices architecture, and cloud-native development patterns.
- Familiarity with Git, CI/CD pipelines, and Infrastructure as Code such as Terraform and Cloud Build.
Compensation and benefits
- Salary range: USD 140,310 - 171,490 per year
- Paid time off
- Medical/dental/vision insurance
- 401(k)
- Suite of well-being benefits to eligible employees
Preferred qualifications
- Google Cloud certifications (e.g., Professional Machine Learning Engineer, Professional Cloud Architect).
- Exposure to multi-agent architectures, tool-use patterns, and agentic AI frameworks.
- Experience with vector databases (e.g., Vertex AI Vector Search, AlloyDB, Pinecone, Weaviate) and embedding-based retrieval.
- Knowledge of MLOps, including experiment tracking, model versioning, A/B testing, and monitoring in production.
- Experience in regulated industries (healthcare, finance, insurance) with understanding of data privacy and compliance requirements.
Technologies you’ll work with
- Google Cloud Platform (GCP), Vertex AI, Vertex AI Agent Builder, Vertex AI Search
- Google Agent Development Kit (ADK), Vertex AI SDK for Python, Google Gen AI SDK
- Cloud Run, Cloud Functions, Pub/Sub, BigQuery, Cloud Build, Terraform
- Python, LangChain, LlamaIndex, TensorFlow, PyTorch, Dialogflow CX, Git
Time type: Full time. Location: Boston, Hingham. Education minimum: High school degree or equivalent required unless otherwise noted above.