DataJobs.io
← Back to all jobs

Job Description

Bain & Co. invites an AI Engineer to join the Coro team and help architect and deploy next-generation AI powered software and data tools. The role centers on designing and executing LLM driven features and agentic workflows across POCs, MVPs, and production deployments within an enterprise environment, with an emphasis on reliability and practical impact. This is an onsite position in Atlanta, GA.

Responsibilities

  • Design and develop GenAI applications such as copilots, workflow automation, and decision-support tools for commercial teams using modern LLM stacks.
  • Implement agentic workflows with clear value, including tool usage, multi-step execution, and human-in-the-loop controls, prioritizing reliability, safety, and transparent failure modes.
  • Design and build advanced search, retrieval, and knowledge pipelines across diverse data structures and stores (hybrid search, vector stores, graph databases/knowledge graphs, and traditional data platforms), covering indexing, metadata design, relevance tuning, freshness, caching, access controls, and source attribution.
  • Develop robust agent capabilities including context engineering, memory and state management (short- and long-term), orchestration, routing, and tool integration patterns.
  • Integrate solutions into enterprise environments and workflows through APIs, data systems, and collaboration tools, balancing quality, latency, cost, privacy, and adoption considerations.
  • Translate ambiguous client needs into clear technical requirements, tradeoffs, and delivery plans.
  • Deliver end-to-end ML solutions: data preparation, feature engineering, model selection, training, validation and testing, and performance analysis.
  • Apply appropriate methods across classical ML and deep learning, including sequence, text, and image models when relevant.
  • Create reproducible training and evaluation pipelines with versioning, experiment tracking, robust validation, and documentation.
  • Demonstrate fluency with modern deep learning concepts, including transformer fundamentals and LLM pre-training versus post-training strategies (e.g., instruction tuning and preference optimization).
  • Write clean, testable, maintainable code and ship AI services through the full SDLC: build, test, deploy, monitor, and iterate.
  • Implement MLOps and GenAIOps practices: CI/CD, reproducibility, environment parity, model/prompt/agent versioning, and operational readiness.
  • Build evaluation and observability for GenAI and agentic systems: tracing and instrumentation, regression test suites, automated scoring where appropriate, and iterative prompt/policy optimization.
  • Design for secure enterprise deployment: access controls, auditability, handling of sensitive and PII data, and responsible AI guardrails.
  • Build reusable components and accelerators (templates, evaluation harnesses, connectors, orchestration patterns) that scale across client contexts.
  • Communicate clearly with technical and non-technical stakeholders; lead working sessions, present recommendations, and document technical details crisply.
  • Collaborate with Bain consultants to prioritize critical technical decisions that unlock business value.
  • Support proposal shaping and scoping: effort sizing, architecture options, risk assessment, and delivery roadmaps.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • 3-5+ years of professional AI/ML engineering experience with strong backend engineering fundamentals.
  • Solid proficiency in Python and experience building APIs/services (REST/gRPC) and integrating with enterprise systems.
  • Hands-on experience building LLM-powered applications with attention to latency, cost, reliability, and security.
  • Experience building advanced retrieval/search systems (hybrid retrieval, vector search, reranking) and working across multiple data stores (vector, graph, relational, document, or search).
  • Experience implementing agentic patterns (context management, tool integration, orchestration, memory/state handling) with modern frameworks (e.g., LangGraph, OpenAI Agents SDK, Pydantic AI) or custom agent loops, with sound judgment on when agentic approaches are appropriate.
  • Experience creating reusable skills, tools, and services (including MCP) for agent use, with schema validation (e.g., Pydantic) to enforce reliable data contracts.
  • Strong engineering practices: testing, code review, version control, CI/CD, and performance profiling.

Technologies

Python, REST, gRPC, LangGraph, OpenAI Agents SDK, Pydantic AI, PyTorch, TensorFlow, AWS, GCP, Azure, Docker, Kubernetes

Benefits

  • Health insurance: Bain pays 100% of individual premiums for medical, dental, and vision plans.
  • Generous paid time off, including parental leave, sick leave, and holidays.
  • Fully vested 401(k) company contribution.
  • Paid life and long-term disability insurance.
  • Annual fitness reimbursements.

Compensation and Related Details

Base salary: USD 128,500 - 171,500 per year, plus an annual discretionary performance bonus. A 401(k) company contribution starts at 4.5% and increases after 3 years of service, fully vested from the start date. This role is based in Georgia, with the stated range applying to eligible locations as described by state requirements.

Similar Jobs