Spatial Data Analyst

Remote evaluation role to review spatial data analyst prompts and outputs against AuraOne's quality rubric, compare paired outputs, label edge cases, and provide structured feedback for retraining.

Responsibilities

• Assess spatial data analyst evaluation model outputs against a versioned quality rubric and apply severity tags for relevant assignments.
• Compare paired responses and select the stronger answer, including a written rationale.
• Tag instances of hallucinations, instruction-following failures, and unsafe content with structured labels.
• Identify ambiguous prompts and route them to the program team for rubric updates.
• Calibrate reviewer-quality scores weekly by comparing results to gold-standard examples.
• Document recurring failure modes to guide the modeling team in the next training cycle.

Requirements

• Prior evaluation, annotation, or human-rater experience on spatial data analyst evaluation or related content for this field.
• Comfort applying multi-page rubrics consistently across large batches.
• Clear written reasoning that specifies the issue and the applicable rubric clause.
• Strong attention to detail and ability to flag when a prompt itself is problematic.
• Reliable asynchronous availability for at least 10 hours per week.

Why this role matters

AI data reviewers turn evaluation outputs into auditable labels, rationales, and regression cases for AuraOne Human Data.

EXAMPLE TASKS

• Compare two spatial data analyst evaluation model responses to the same prompt and select the stronger one with a rationale.
• Tag an unsafe response with the correct policy category and severity.
• Audit a 50-row batch for rubric consistency and report drift to the program lead.
• Propose a rubric clarification after spotting a recurring failure mode.

NICE TO HAVE

• Background in linguistics, content moderation, or trust and safety review.
• Experience with inter-rater agreement metrics and calibration cycles.
• Domain expertise that helps spot subject-matter errors automated checks miss.

SKILLS

• Model output evaluation
• Rubric-based annotation
• Severity tagging
• Inter-rater calibration
• Spatial Data Analyst evaluation

WORK MODEL

• Remote, US-eligible; Independent specialist contractor.
• Employment type: CONTRACTOR.
• Applicants must be authorized to work from the US.

COMPENSATION

• USD 125 per hour.

APPLICATION PROCESS

• Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.