AI Engineer

Remote AI Engineer role focused on evaluating production code and AI outputs for correctness by reproducing failures, writing the unit tests the model should have written, and explaining fixes to guide the modeling team.

Job details

• Location: Remote
• Salary: USD 50 - 120 per hourly
• Type: Contract

Responsibilities

• Execute candidate code outputs in a sandbox to verify AI Engineer assignments and reproduce issues.
• Assess AI engineering submissions for correctness, complexity, idiomatic style, and edge-case handling.
• Write minimal failing tests that expose bugs a model output missed.
• Compare paired solutions and assign a ranking with a written rationale aligned to the rubric.
• Identify and label failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
• Document recurring code-generation failures so the modeling team can target them.
• Calibrate against gold-standard reviews to maintain inter-rater agreement above target.

Requirements

• Strong day-to-day engineering experience — you can read, run, and debug unfamiliar code for AI engineer work.
• Ability to craft concise unit tests that isolate a single failure mode.
• Familiarity with at least one of: pytest, Jest, JUnit, Go test, RSpec, or equivalent.
• Clear written reasoning — your review notes should persuade a senior engineer.
• Reliable async availability for at least 10 hours per week.
• Prior code-review or technical-interview-grading experience is a plus.

Technologies

• pytest
• Jest
• JUnit
• Go test
• RSpec
• C#
• C++
• GoLang
• JAVA
• .NET
• PHP
• Python

Example Tasks

• Reproduce a generated engineering solution for a coding task, run the test suite, and evaluate it.
• Draft the smallest failing test that demonstrates a model's edge-case bug.
• Compare two paired solutions and rank them with a rubric-based written justification.
• Triage a security issue surfaced by a model and document the patch the model should have produced.

Nice to Have

• Open-source contributions or a public portfolio showing production-quality code.
• Experience with the target language's standard tooling, linters, and idiomatic style guidelines.
• Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.

Skills

• Code review
• Debugging
• Unit testing
• Software engineering judgment
• AI engineering
• C#
• C++
• GoLang
• JAVA
• .NET
• PHP
• Python