Llm Stacks Data Jobs

1 job found

Today

Expert Consultant, Coro, AI Engineer

Bain & Co. Houston, TX

Houston, TX

Today

$129k - $172k/yr Full time Python Agentic Ai AI

Apply Now

Job Description

Join Bain & Company's Coro team as an AI Engineer to design and deploy GenAI powered features and agentic workflows from rapid proofs of concept to production, turning client data into structured analytics and synthesized outputs.

Responsibilities

Design and build GenAI applications including copilots, workflow automation, and decision-support for commercial teams using modern large language model stacks.
Implement agentic workflows with clear value, including tool use, multi-step execution, and human-in-the-loop controls, emphasizing reliability, safety, and clear failure modes.
Design and construct advanced search, retrieval, and knowledge pipelines across diverse data structures and stores (hybrid search, vector stores, graph databases/knowledge graphs, traditional data platforms) with indexing, metadata, relevance tuning, freshness, caching, access controls, and source attribution.
Develop robust agent capabilities such as context engineering, memory and state management, orchestration, routing, and tool integration patterns.
Integrate solutions into enterprise environments and workflows (APIs, data systems, collaboration tools) while balancing quality, latency, cost, privacy, and adoption.
Translate ambiguous client needs into clear technical requirements, tradeoffs, and delivery plans.
Deliver end-to-end ML solutions including data preparation, feature engineering, model selection, training, validation and testing, and performance analysis.
Apply methods spanning classical ML and deep learning, including sequence, text, and image models when relevant.
Create reproducible training and evaluation pipelines with versioning, experiment tracking, robust validation, and documentation.
Demonstrate fluency with modern deep learning concepts, transformer fundamentals, and LLM pre-training versus post-training concepts (e.g., instruction tuning and preference optimization).
Write clean, testable, maintainable code and ship AI services through the full SDLC: build, test, deploy, monitor, and iterate.
Implement MLOps and GenAIOps practices: CI/CD, reproducibility, environment parity, model/prompt/agent versioning, and operational readiness.
Build evaluation and observability for GenAI and agentic systems: tracing, instrumentation, regression test suites, automated scoring where appropriate, and iteration loops for prompts and policy optimization.
Design for secure enterprise deployment: access controls, auditability, data handling for sensitive and PII data, and responsible AI guardrails.
Build reusable components and accelerators (templates, evaluation harnesses, connectors, orchestration patterns) that scale across client contexts.
Communicate clearly with technical and non-technical stakeholders; lead working sessions, present recommendations, and write crisp technical documentation.
Collaborate with Bain consultants to prioritize critical technical decisions that unlock business value.
Support proposal shaping and scoping: effort sizing, architecture options, risk assessment, and delivery roadmaps.

Requirements

Bachelor’s degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
3-5+ years of professional AI/ML engineering experience (or equivalent), with strong backend engineering fundamentals.
Strong proficiency in Python and experience building APIs / services (REST / gRPC) and integrating with enterprise systems.
Hands-on experience building LLM-powered applications with attention to latency, cost, reliability, and security.
Experience building advanced retrieval / search systems (hybrid retrieval, vector search, reranking) and working across data stores (vector, graph, relational / document / search).
Experience implementing agentic patterns (context management, tool integration, orchestration, memory / state handling) with modern frameworks (e.g., LangGraph, OpenAI Agents SDK, Pydantic AI) or custom agent loops, and sound judgment on when agentic approaches are appropriate.
Experience creating reusable skills, tools, and services (including MCP) for agent use, with schema validation (Pydantic) to enforce reliable data contracts.
Strong engineering practices: testing, code review, version control, CI/CD, and performance profiling.
Experience deploying and operating services on AWS, GCP, and / or Azure (environment management, reliability, observability, scaling).
Experience with Docker and Kubernetes (or equivalent orchestration) and operating services in production (debugging, performance, resilience).
Proven ability to implement security, privacy, and governance requirements for AI systems (authentication / authorization, access controls, PII / sensitive data handling, enterprise risk controls).
Experience training, validating, and testing ML models; strong understanding of overfitting, generalization, and evaluation methodology.
Practical experience with feature engineering and data preprocessing for real-world datasets.
Familiarity with a broad set of ML algorithms (classical ML and deep learning), and ability to choose methods that fit business and data constraints.
Familiarity with deep learning frameworks (PyTorch / TensorFlow) and ML lifecycle tooling (experiment tracking, model registry, feature store concepts).
Proven ability to operate in ambiguity and complexity, manage priorities, and deliver outcomes independently or with a team.
Excellent interpersonal and communication skills; able to explain technical decisions, tradeoffs, and results to mixed audiences.
Strong stakeholder management; comfortable working directly with clients.
MBA or PhD in a technical field.
Background in consulting, professional services, or B2B analytics environments.
Experience working with major AI ecosystem partners on real client deployments.

Technologies

Python
REST, gRPC
LangGraph
OpenAI Agents SDK
Pydantic AI
MCP
PyTorch
TensorFlow
Docker
Kubernetes
AWS, GCP, Azure
Graph databases, vector stores, knowledge graphs

Benefits

Bain pays 100% of individual employee premiums for medical, dental, and vision programs.
Generous paid time off, including parental leave, sick leave, and paid holidays.
Fully vested 401(k) company contribution.
Paid Life and Long-Term Disability insurance.
Annual fitness reimbursements.
4.5% 401(k) company contribution, increasing after 3 years of service and 100% vested upon start date.

Compensation

Base salary range: USD 128,500 - 171,500 per year. Compensation includes base salary, annual discretionary performance bonus, and a 401(k) plan with employer contributions based on years of service, plus Bain’s comprehensive benefits package. The 4.5% 401(k) company contribution increases after 3 years of service and is 100% vested from start date.

Visible links

View full job page →

Get Llm Stacks Data Jobs alerts

New Llm Stacks Data Jobs, daily.