Legal Research AI Evaluation SME

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people start and grow freelance careers teaching AI by consolidating opportunities, tracking work, and building a unified portfolio contributors control. Creating an OpenTrain account is free.

About AI Training Work

AI training (also called data labeling or human feedback work) is the human side of building modern AI systems. Contributors annotate, evaluate, and improve model outputs so legal AI behaves reliably and defensibly. This work is remote, often flexible, accessible to experienced practitioners, and lets you shape how state-of-the-art systems reason about law.

The role

You will serve as a subject-matter expert reviewing AI-generated legal research and producing gold-standard outputs. Your work guides model evaluation across issue analysis, jurisdiction handling, authority selection, citation accuracy, and rule application.

This is hourly contract work, part-time (20+ hours/week), remote across multiple countries. Label types include evaluation ratings and text generation; primary data type is text.

• Employment type: Contractor, Part-time
• Time: 20+ hours/week
• Labeling work: EVALUATION_RATING and TEXT_GENERATION on text data

What you'll do

Provide expert review and written feedback on AI-generated legal research, assessing correctness, clarity, completeness, and adherence to prompts.

Create model research memos and gold-standard legal outputs that demonstrate careful reasoning and reliable citation support.

• Review AI answers for accuracy, clarity, completeness, and prompt adherence
• Identify errors in issue spotting, jurisdiction handling, authority selection, citation accuracy, and rule application
• Write model research memos, authority summaries, issue outlines, research plans, and memo templates
• Evaluate and rank model responses for correctness, defensibility, citation support, and clarity
• Test outputs for misleading certainty, jurisdictional errors, bias, and reliability across scenarios

Requirements

You must have substantive legal research experience and the ability to produce clear, defensible written analysis in English.

• JD, LLB, or equivalent legal research background with substantial primary-law research experience
• Strong experience interpreting statutes, regulations, and case law, including distinguishing holdings from dicta and assessing procedural posture
• Excellent citation hygiene: quotation verification, pinpoint citations, and checking support for propositions
• Ability to handle jurisdictional variation and clearly state assumptions or limits
• Professional-level English (minimum C1) with clear, concise legal writing
• Familiarity with legal research tools (Westlaw, Lexis, or equivalents) is a plus
• Prior experience with AI data training, editorial QA, knowledge management, or legal publishing is strongly preferred

Helpful background and who should apply

Ideal applicants are practicing or former practitioners with structured legal research workflows—from issue framing through authority retrieval and synthesis—and experience comparing authorities and identifying weak support.

This role suits people comfortable working across time zones in an hourly remote contractor setting and those interested in directly shaping how legal AI systems reason and cite authorities.

• Experience producing memo-style legal research outputs or working in legal publishing
• Experience evaluating model outputs, annotating legal text, or working in AI-training projects

Pay, location, and team size

This is hourly contract work. Advertised rates vary by location (from up to $40/hour to up to $110/hour); this posting includes roles that pay up to $110/hour. Hiring is remote across the listed countries and may include other locations within the hiring regions.

Total headcount across countries: 850.

• Currency: USD
• Pay type: PAY_PER_HOUR (up to $110/hr advertised)
• Languages required: English (en)
• Countries hiring include: VN, TL, TH, SG, PK, PH, NP, MY, LK, KH, ID, BT, BD, IN, BR, DE, US

How to apply and how to stand out

Apply through your OpenTrain profile—create one for free if you don't have it yet. Include a resume/CV and examples of legal research or writing (memos, authority summaries, or published work) that demonstrate careful citation and reasoning.

To stand out, show concise written analysis, examples comparing authorities, experience identifying weak support, and any prior AI-training or annotation work.

• Provide clear samples of legal research or editorial work
• Highlight jurisdictional experience and familiarity with primary authorities
• Note any prior AI labeling, QA, or legal publishing experience