Machine Learning Engineer Talent Network

AuraOne Human Data seeks a remote reviewer to evaluate AI outputs within machine learning engineer specialist operations. The role involves grading workflow correctness, policy adherence, and stakeholder fit, while flagging operational risks and documenting next steps to support model training.

Responsibilities

• Assess AI outputs against current machine learning engineer specialist operations workflows, playbooks, and firm policy for Talent Network assignments.
• Rate tone, escalation logic, and stakeholder fit using a structured rubric.
• Identify operational risk, missed escalations, and policy adherence gaps, applying severity tags as needed.
• Document the appropriate next steps to guide the modeling team in subsequent training efforts.
• Resolve disputed treatments by comparing against published playbooks or firm guidance.
• Maintain reviewer quality scores during inter-rater calibration cycles.

Requirements

• Direct hands-on experience in machine learning engineer specialist operations on real teams participating in Machine Learning Engineer Talent Network work.
• Ability to apply multi-page rubrics consistently across large batches.
• Clear written reasoning that explicitly names the policy or workflow being applied.
• Strong attention to detail and the ability to identify when a prompt itself presents a problem.
• Reliable asynchronous availability for at least 10 hours per week.

Technologies

• Python

Benefits

• Prior experience training, calibrating, or QA-ing operations teams.
• Familiarity with AI assisted workflow tooling and its failure modes.
• Bilingual experience for cross region operations.

Why this role matters

This role ensures that machine learning engineer specialist operations fit into real workdays. AuraOne employs experienced operators to grade outputs as a senior peer would, verifying workflow, policy, and the unwritten rules that determine whether a task gets done.

Example Tasks

• Grade a model response to a real ML engineer specialist operations ticket, evaluating workflow, tone, and escalation.
• Flag a missed escalation with the correct severity tag and specify the corrected next step.
• Adjudicate a disputed playbook decision between two reviewers using firm guidance.
• Audit a batch of 25 items for rubric consistency and report any drift to the program lead.

Skills

• Operational review
• Policy adherence
• Workflow judgment
• Stakeholder communication
• Machine Learning Engineer specialist operations
• Python

Work Model

• Remote eligible for US-based candidates
• Independent specialist contractor
• Employment type: CONTRACTOR
• Applicants must be authorized to work from the US

Compensation

$70–$250 / hr

Application Process

Apply through AuraOne's specialist intake for role specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.