Legal AI Evaluation Expert (Remote Contract)

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We make it easy for legal experts to discover specialized AI training work, consolidate proof of experience into a single profile, and grow a durable freelance career evaluating model outputs.

As the hiring organization for this role, OpenTrain connects your legal expertise directly to AI projects that need precision, doctrinal knowledge, and careful feedback.

• Centralized profile that showcases your AI training experience and feedback work
• Flexible, remote contract opportunities that fit around other commitments

Why AI Training In Law Matters

Modern legal AI systems learn from examples and expert review. Human reviewers shape how models analyze facts, cite authority, and form legal arguments—work that directly affects accuracy, fairness, and usefulness in legal applications.

This role gives you the chance to influence model reasoning, reduce legal errors, and help build safer, more reliable legal AI tools.

The Role

You will evaluate AI-generated legal analyses and provide precise, actionable feedback. Tasks include assessing correctness, issue spotting, citation accuracy, doctrinal soundness, and the quality of explanations and model solutions.

This is a part-time remote contractor position requiring deep legal reasoning and clear written communication; you will compare and rank multiple model responses and help identify inaccuracies, bias, and logical weaknesses.

• Employment type: Contractor, Part-time
• Time commitment: 20+ hours/week
• Pay: USD $115/hour

What You'll Do

Daily work centers on reviewing text outputs from legal-focused models and producing structured evaluations and corrective guidance.

• Review AI-generated legal analyses and expert legal content for accuracy and clarity
• Evaluate reasoning quality, issue spotting, and adherence to the prompt
• Fact-check citations, legal rules, and doctrinal statements against governing authority
• Write clear feedback, explanations, and model solutions that explain correct reasoning
• Compare and rank multiple responses by correctness and reasoning quality
• Identify inaccuracies, bias, procedural errors, and logical weaknesses in model outputs

Requirements

We must be able to rely on your legal training and analytical precision. Please meet the core requirements below.

• Law degree or equivalent background in Law, Legal Studies, Public Policy, or Political Science
• Strong grounding in constitutional law, contracts, torts, criminal law, civil procedure, and regulatory or administrative law
• Proven legal reasoning skills: statutory interpretation, case analysis, translating facts into elements and defenses
• High attention to detail with citations, jurisdictional rules, procedure, and logical consistency
• Minimum C1 English proficiency
• Previous experience with AI data training, expert review, legal editing, or QA preferred

Who Should Apply

This contract is a strong match for practicing or former attorneys, legal academics, legal policy analysts, and experienced paralegals who can write structured legal analysis and assess model outputs against authoritative law.

• People comfortable producing short model solutions and clear written feedback
• Reviewers who can quickly spot issues in reasoning, citation, and procedural posture
• Candidates who want steady part-time work and to build an OpenTrain profile of AI training experience

Pay, Hours & Logistics

This is a remote, contractor role paid hourly through OpenTrain. You must be able to commit at least 20 hours per week and reside in one of the approved countries listed below.

• Rate: USD $115 per hour (fixed hourly rate)
• Minimum weekly commitment: 20+ hours
• Languages: English (minimum C1 proficiency)
• Allowed locations: Vietnam; Timor-Leste; Thailand; Singapore; Pakistan; Philippines; Nepal; Malaysia; Sri Lanka; Cambodia; Indonesia; Bhutan; Bangladesh; Brazil; India; Germany; United States
• Data type: Text labeling and evaluation (RLHF, evaluation ratings, text generation)
• Workflows: Review, rate, rank, and write feedback on model outputs as part of OpenTrain projects