DataJobs.io
← Back to all jobs

Job Description

What you’ll get

AuraOne Human Data is hiring an independent contract Data Analyst for remote reviewer work focused on AI output quality. You’ll join a remote reviewer track evaluating AI responses across data analyst specialist operations workflows, using structured rubrics to assess correctness, policy adherence, and stakeholder fit. The role is designed for careful operational review and clear documentation so the modeling team can train on the right next steps.

Responsibilities

  • Review AI outputs against current data analyst specialist operations workflows, playbooks, and firm policy for Data Analyst assignments.
  • Grade tone, escalation logic, and stakeholder fit using a structured rubric.
  • Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
  • Capture the right next step so the modeling team can train on it.
  • Adjudicate disputed treatments against published playbooks or firm guidance.
  • Maintain reviewer-quality scores through inter-rater calibration cycles.

Examples of reviewer tasks

  • Grade a model response to a real data analyst specialist operations ticket and rate workflow, tone, and escalation.
  • Identify a missed escalation, apply the correct severity tag, and specify the corrected next step.
  • Adjudicate a disputed playbook call between reviewers using firm guidance.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Requirements

  • Direct working experience in data analyst specialist operations on real teams for Data Analyst work.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that names the policy or workflow being applied.
  • Strong attention to detail, including the ability to flag when a prompt itself is the problem.
  • Reliable async availability for at least 10 hours per week.

Nice to have

  • Prior experience training, calibrating, or QA-ing operations teams.
  • Familiarity with AI-assisted workflow tooling and its failure modes.
  • Bilingual experience for cross-region operations.

Work model and eligibility

Remote (US-eligible). Employment type: CONTRACTOR. Applicants must be authorized to work from the US.

Compensation

Hourly rate is confirmed after the interview process.

Application process

Apply through AuraOne’s specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Similar Jobs