DataJobs.io
← Back to all jobs

Job Description

AuraOne Human Data is assembling a remote team of scientific reviewers to audit AI outputs for research science reasoning, calculations, and workflows. In this contract role, you will reproduce key results and clearly document the correct method so the modeling team can train on robust, verifiable pathways.

Responsibilities

  • Review AI outputs against current research science methods, conventions, and prior work for Data Scientist assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Requirements

  • Graduate-level training or equivalent applied experience in research science or a closely related field for Data Scientist work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Technologies

  • aws
  • azure

Why this role matters

Research science models depend on rigorous scrutiny of their derivations. AuraOne employs scientific specialists to grade outputs as a peer reviewer would, checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one to guide training data.

Example tasks

  • Reproduce a research science derivation from a model output and flag algebraic or dimensional errors.
  • Grade a modelโ€™s literature summary against the cited papers and assess citation quality.
  • Adjudicate a disputed answer between reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Research science
  • Attention to detail
  • Autonomous work
  • AWS
  • Azure
  • Cloud computing
  • Cross-functional collaboration
  • Curiosity

Work model

Remote โ€” US eligible. Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from the US.

Compensation

USD 59โ€“114 per hour

Application process

Apply through AuraOne's specialist intake for role specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Similar Jobs