Paralegal AI Evaluation SME

About OpenTrain

OpenTrain is the #1 platform for people building careers in AI training and data labeling. We help legal and other specialists find work, consolidate projects into a single portfolio, and grow a durable freelance career in the human side of AI.

OpenTrain AI is the hiring and contracting organization for this role. Creating an OpenTrain account is free and lets you apply, track projects, and build a profile that showcases your paralegal AI training work.

• Focused on AI training and data-labeling careers — work that directly shapes how modern AI behaves.
• Remote-friendly, flexible project work that fits around other commitments.

About AI training work

AI training (also called data labeling or human feedback) is the human expertise behind model behavior: reviewing outputs, rating responses, and producing reference examples that teach systems to be accurate and useful.

Contributors do text, audio, image, or mixed annotation work; this role focuses on text-based legal evaluation and content creation.

• Great for part-time, remote work with flexible hours.
• Accessible to professionals with real-world domain experience rather than prior AI experience.

The role

As a Paralegal AI Evaluation SME you will evaluate AI-generated legal support responses, create gold‑standard paralegal deliverables, and help improve the clarity, accuracy, and safety of legal model outputs.

This is a contractor, part-time role with a minimum expected commitment of 20+ hours per week. Work is text-based and involves both evaluation/rating and generation of paralegal content.

• Employment type: Contractor, Part-time.
• Time requirement: 20+ hours per week.
• Pay: Hourly, USD $20–$50/hr.
• Work type: Text evaluation and text generation (EVALUATION_RATING, TEXT_GENERATION).
• Language: English (C1 proficiency required).
• Eligible countries: BD, BT, BR, KH, DE, IN, ID, MY, NP, PK, SG, LK, TH, PH, US, TL, VN.

What you'll do

Your day-to-day work mixes careful evaluation of AI responses with authoring expert paralegal materials that serve as training references and quality standards.

• Review AI-generated legal support responses for accuracy, completeness, clarity, and adherence to prompts.
• Identify errors in legal terminology, procedural steps, document structure, issue spotting, and citation or authority handling.
• Rate and compare multiple AI responses for correctness, reasoning quality, formatting, and procedural usefulness.
• Write gold-standard paralegal deliverables: prompts, document templates, checklists, research summaries, and drafting examples.
• Test AI outputs for misleading certainty, confidentiality risks, and bias across typical legal support use cases.

Requirements

Candidates must bring real paralegal experience and strong legal support skills — this role relies on domain knowledge and careful judgment rather than previous AI training experience.

• Associate’s or Bachelor’s degree in Paralegal Studies, Legal Studies, or related field; paralegal certification is a plus.
• 4+ years of professional experience as a paralegal or legal assistant.
• Strong command of legal support workflows, including intake, fact gathering, drafting, version control, and matter organization.
• Proven legal research ability and experience summarizing authorities (cases, statutes, regulations).
• Familiarity with litigation processes or transactional workflows, depending on your lane.
• C1 English proficiency, excellent attention to detail, and strict confidentiality awareness.
• Comfort working as a remote contractor across time zones and meeting deadlines.

Additional capabilities we value

These are not strict requirements but will help you succeed and move quickly into high-impact tasks.

• Prior experience with AI data training, document QA, legal ops, or editorial review.
• Experience with e-discovery, contracts, court filings, or litigation support.
• Careful cite-checking and concise authority summaries on unfamiliar issues.
• Ability to draft and revise legal text accurately under deadline pressure.