Talent Pool Data Jobs

1 job found

1d ago

Machine Learning Engineer Talent Network

AuraOne Human Data Remote 🇺🇸 Remote

Remote

1d ago

$70 - $250/hr Contract Ai Evaluation Ai Ml Artificial Intelligence

Apply Now

Job Description

AuraOne Human Data seeks a remote reviewer to evaluate AI outputs within machine learning engineer specialist operations. The role involves grading workflow correctness, policy adherence, and stakeholder fit, while flagging operational risks and documenting next steps to support model training.

Responsibilities

Assess AI outputs against current machine learning engineer specialist operations workflows, playbooks, and firm policy for Talent Network assignments.
Rate tone, escalation logic, and stakeholder fit using a structured rubric.
Identify operational risk, missed escalations, and policy adherence gaps, applying severity tags as needed.
Document the appropriate next steps to guide the modeling team in subsequent training efforts.
Resolve disputed treatments by comparing against published playbooks or firm guidance.
Maintain reviewer quality scores during inter-rater calibration cycles.

Requirements

Direct hands-on experience in machine learning engineer specialist operations on real teams participating in Machine Learning Engineer Talent Network work.
Ability to apply multi-page rubrics consistently across large batches.
Clear written reasoning that explicitly names the policy or workflow being applied.
Strong attention to detail and the ability to identify when a prompt itself presents a problem.
Reliable asynchronous availability for at least 10 hours per week.

Technologies

Python

Benefits

Prior experience training, calibrating, or QA-ing operations teams.
Familiarity with AI assisted workflow tooling and its failure modes.
Bilingual experience for cross region operations.

Why this role matters

This role ensures that machine learning engineer specialist operations fit into real workdays. AuraOne employs experienced operators to grade outputs as a senior peer would, verifying workflow, policy, and the unwritten rules that determine whether a task gets done.

Example Tasks

Grade a model response to a real ML engineer specialist operations ticket, evaluating workflow, tone, and escalation.
Flag a missed escalation with the correct severity tag and specify the corrected next step.
Adjudicate a disputed playbook decision between two reviewers using firm guidance.
Audit a batch of 25 items for rubric consistency and report any drift to the program lead.

Skills

Operational review
Policy adherence
Workflow judgment
Stakeholder communication
Machine Learning Engineer specialist operations
Python

Work Model

Remote eligible for US-based candidates
Independent specialist contractor
Employment type: CONTRACTOR
Applicants must be authorized to work from the US

Compensation

$70–$250 / hr

Application Process

Apply through AuraOne's specialist intake for role specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

View full job page →

Get Talent Pool Data Jobs alerts

New Talent Pool Data Jobs, daily.