Work remotely in a contract reviewer role at AuraOne Human Data. This benefits-forward opportunity puts you at the center of AI governance by evaluating outputs across machine learning engineer specialist operations workflows. You’ll work asynchronously to grade workflow correctness, policy adherence, and stakeholder fit, flag operational risks, and document the exact next steps so the modeling team can improve training data. Flexible, remote participation and a focus on practical impact define this position.
Responsibilities
- Assess AI outputs against current machine learning engineer specialist operations workflows, playbooks, and firm policy for ML Engineer tasks.
- Apply a structured rubric to judge tone, escalation logic, and stakeholder alignment.
- Identify operational risks, missed escalations, and gaps in policy adherence, tagging them by severity.
- Document the precise next action to inform model training and future reviews.
- Resolve disputed treatments by referencing published playbooks or firm guidance.
- Maintain reviewer quality scores through inter-rater calibration cycles.
Requirements
- Direct hands-on experience in machine learning engineer specialist operations on active teams performing ML Engineer work.
- Comfort applying long, multi-page rubrics consistently across large batches.
- Clear, written reasoning that identifies the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself causes the issue.
- Reliable asynchronous availability for at least 10 hours per week.
Why this role matters
In machine learning engineer specialist operations, real workday context matters. AuraOne relies on experienced operators who grade outputs as a senior peer would, verifying workflow alignment, policy compliance, and the unwritten rules that determine whether a task gets completed.
Example tasks
- Grade a model’s response to a real ML operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the appropriate severity tag and a corrected next step.
- Adjudicate a disputed playbook decision between reviewers using firm guidance.
- Audit a 25-item batch for rubric consistency and report drift to the program lead.
Nice to have
- Experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Skills
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Machine Learning Engineer specialist operations
Work model
Remote — US eligible. Independent specialist contractor role with CONTRACTOR employment status. Applicants must be authorized to work from the United States.
Compensation
Hourly rate to be confirmed after the interview process.
Application process
Apply through AuraOne’s specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
