Legal Benchmark Question Author and Reviewer

About OpenTrain

OpenTrain AI is the organization recruiting for this contract opportunity. OpenTrain is the leading platform for finding and building careers in AI training and data labeling, helping contributors discover projects, build a professional profile, and apply in minutes.

• Free OpenTrain account creation
• Remote opportunities across the growing AI training industry
• A platform for building a lasting AI training career

About AI Training Work

AI training is the human work behind modern artificial intelligence. Legal specialists contribute by creating and reviewing carefully designed examples that help evaluate how well AI systems reason about complex concepts, rules, and real-world questions.

• Shape how advanced AI systems understand and respond to legal content
• Use specialized legal knowledge in a growing technology field
• Work remotely with an asynchronous, flexible schedule

The Role

OpenTrain AI is recruiting a Legal Benchmark Question Author and Reviewer to create and verify high-quality multiple-choice assessment content for an AI research initiative. You will help establish gold-standard benchmarks for AI capabilities across core legal domains, including Intellectual Property, Securities, Antitrust, Healthcare, and Environmental Law.

This is an asynchronous, fully remote contractor role requiring a commitment of 10 or more hours per week. The pay rate is $83 to $105 per hour.

• Role type: Part-time contractor
• Schedule: Asynchronous and fully remote
• Expected commitment: 10+ hours per week
• Pay: $83-$105 per hour
• Primary language: English

What You’ll Do

You will author original, challenging legal questions and review questions prepared by others. Each item should test meaningful legal reasoning, offer one correct answer alongside plausible alternatives, and include a clear explanation of the solution.

• Write original multiple-choice questions across core law domains
• Rate each question as Medium, Hard, or Expert, spanning undergraduate through post-graduate difficulty
• Provide one correct answer and nine plausible but subtly incorrect alternatives
• Write clear, step-by-step chain-of-thought solutions in markdown format
• Verify questions for accuracy, clarity, and rigor
• Document any edits made during verification tasks

Required Qualifications

This role requires advanced legal education or doctoral-level legal study, along with strong legal reasoning and writing ability. Candidates should be able to express complex legal ideas clearly and concisely in excellent written English.

• JD, LLM, SJD, or doctoral candidacy in Law or a closely related field
• A master’s degree may be considered with exceptional depth in a specific legal subdomain
• Strong command of legal reasoning, statutory interpretation, and jurisprudential theory
• Excellent written English for complex legal content
• Evidence of experience in legal academia, bar exam writing, or judicial clerkships

Helpful Background

Experience designing assessment content can help you develop rigorous, discriminating questions for AI benchmarks. Familiarity with authoritative legal research sources is also useful for checking accuracy and strengthening explanations.

• Experience with multiple-choice question design
• Assessment writing experience
• Legal research using peer-reviewed journals and legal repositories
• Background in legal academia, bar exam writing, or judicial clerkships

How to Apply

Create a free profile on OpenTrain and apply through the platform. Highlight your legal education, relevant writing or research experience, and any background creating assessments or evaluating complex legal content.

• Apply through OpenTrain AI
• Show evidence of advanced legal training
• Describe relevant legal writing, research, or assessment experience
• Confirm your availability for at least 10 hours per week