Legal AI Evaluation Lawyer

You will help improve AI systems by reviewing how they handle legal questions and documents. Your work will cover complex scenarios involving litigation, corporate transactions, and regulatory or compliance matters.

You will assess the legal issues, relevant principles, factual gaps, competing interpretations, and reasoning behind each AI-generated response. You will also provide clear corrections and structured feedback that make legal outputs more reliable.

• Review AI-generated legal analyses, arguments, contracts, and other legal documents.
• Identify legal errors, unsupported conclusions, missing information, and weak reasoning.
• Judge whether conclusions are accurate, complete, and supported by the facts and applicable law.
• Apply professional judgment to complex or ambiguous legal situations.
• Write clear feedback and corrections for AI-generated legal outputs.

What it pays and takes

This is a remote, part-time contractor opportunity for legal professionals who can work independently and communicate clearly in written English.

• Pay: $100 to $170 per hour.
• Location: Open to candidates in the United States.
• Language: Professional fluency in English.
• Education: Juris Doctor degree from a U.S. law school.
• License: Active bar license in at least one U.S. state or the District of Columbia.
• Experience: More than three years of substantive legal practice after earning a J.D.
• Skills: Strong legal reasoning, issue spotting, legal writing, document review, attention to detail, and independent work.
• Relevant backgrounds may include litigation, corporate, commercial, employment, personal injury, criminal, family, immigration, insurance, intellectual property, healthcare, securities, real estate, tax, privacy, environmental, or regulatory law.
• Helpful experience includes reviewing complex legal documents, assessing competing legal arguments, identifying substantive errors, or using legal technology and AI-assisted research.

How it works

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 3 screening questions.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing model responses and rating their quality. Legal professionals are needed when a project requires careful judgment about laws, facts, risks, and competing interpretations.