Legal AI Evaluation Attorney

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help contributors discover specialized projects, build a professional profile, and apply their expertise to work shaping how modern AI systems perform.

• Create a free OpenTrain account and apply in minutes
• Build a lasting portfolio of AI training experience
• Find flexible remote opportunities aligned with your professional background

About AI Training Work

AI training is the human side of building artificial intelligence. Expert contributors review model outputs, create challenging examples, and provide feedback that helps AI systems produce more accurate, useful, and reliable responses.

• Apply professional judgment to real AI model outputs
• Help improve the quality and reliability of generative AI
• Work remotely with flexible part-time scheduling

The Role

OpenTrain is seeking a Legal AI Evaluation Attorney to assess AI-generated responses involving legal analysis, contract interpretation, and complex legal questions. You will evaluate whether answers are accurate, rigorous, properly supported, and grounded in sound legal reasoning.

This specialized expert-review opportunity is designed for attorneys who can identify subtle weaknesses in legal analysis and explain their decisions clearly in plain English. Particular attention will be given to flawed reasoning, hallucinated citations, unsupported conclusions, and jurisdictional errors.

• Role type: Remote contractor, part time
• Time requirement: 20+ hours per week
• Location: Candidates based in an English-speaking country
• Language: English
• Compensation: $245-$280 per hour
• Data type: Text
• Work types: Evaluation and rating, text generation, and RLHF

What You'll Do

You will combine legal expertise with careful written analysis to produce structured feedback for AI training. Your work will help models handle legal questions more accurately and reason more responsibly.

• Review AI model responses to legal questions for accuracy and reasoning quality
• Evaluate contract interpretation and broader legal analysis against appropriate standards of rigor
• Draft expert-level prompts that test legal reasoning and domain knowledge
• Create reference answers demonstrating accurate and well-supported legal analysis
• Write detailed critiques identifying unsupported conclusions and flawed reasoning
• Flag hallucinated citations and jurisdictional mistakes
• Provide structured feedback designed to improve model performance on legal tasks

Requirements

This role requires professional legal experience and the ability to evaluate complex legal answers with precision. You should be comfortable distinguishing persuasive analysis from unsupported conclusions and communicating your reasoning in clear, accessible language.

• At least one year of experience as an attorney at a top-tier law firm
• Some top-tier law firm experience within the past seven years
• Strong legal writing skills and clear plain-English communication
• Ability to evaluate legal reasoning, contract interpretation, and complex legal answers
• Ability to assess citation reliability and jurisdiction-specific correctness
• Undergraduate education from a top-ranked university
• Ability to identify hallucinated citations, flawed analysis, and jurisdictional errors
• Ability to draft authoritative prompts, reference answers, and detailed critiques

Who Should Apply

This opportunity may suit attorneys who want to apply their legal judgment to cutting-edge AI development while working remotely. It is especially relevant for candidates who enjoy rigorous analysis, careful writing, and explaining why a legal answer succeeds or fails.

• Attorneys with at least one year at a top-tier law firm
• Legal professionals experienced in contract interpretation or complex legal analysis
• Strong legal writers who can explain technical reasoning for a clear audience
• Candidates seeking flexible, part-time expert work in AI training

How to Apply Through OpenTrain

Create a free OpenTrain account to build your profile and apply for this opportunity. OpenTrain helps professionals turn AI training projects into a growing portfolio while connecting their expertise with specialized work across the industry.

• Set up your OpenTrain profile
• Highlight your attorney experience and legal writing strengths
• Review the role details and submit your application
• Complete any required project evaluation or onboarding steps