Security Review AI Training Expert

About OpenTrain

OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people discover projects, build a unified AI-training portfolio, and grow a durable freelance career working on the human side of AI.

OpenTrain AI is hiring and contracting directly for this role. We focus on specialized, remote-friendly projects that let experienced professionals shape how AI systems interpret real-world evidence and decisions.

About AI training and this work

AI training (data labeling and human feedback) is the essential human work that teaches models how to judge and generate correct outputs. Contributors annotate documents, evaluate responses, and author rubrics that define high-quality decisions.

This project trains models to perform realistic security procurement reviews: your expert judgments will become the gold standard used to train and evaluate AI systems that read SOC 2 reports, security questionnaires, and penetration-test evidence.

The role

As a Security Review AI Training Expert you will author, validate, and score security-review tasks that simulate procurement workflows. You will encode how an experienced reviewer evaluates vendor evidence, writes step-level rubrics, and produces golden responses.

This is a remote contract, part-time role requiring at least 20 hours per week. The project focuses on document-based evaluation and text-generation labels (rubrics, written judgments, and model-response seeds).

• Contract type: Contractor, Part-time
• Time requirement: 20+ hours/week
• Work type: Remote; candidates must be located in US, CA, or MX and fluent in English

What you'll do

You will review simulated vendor security materials against defined buyer standards, identify subtle issues a surface review could miss, and write rubric-style judgments and golden responses representing an expert reviewer's conclusions.

• Review SOC 2 reports, security questionnaires, and pen-test evidence for compliance and scope issues
• Identify mismatches, lapsed bridge letters, scope gaps, and evidence-quality problems
• Author step-level rubrics and golden responses for evaluation and text-generation tasks
• Assess data-handling risk and third-party/sub-processor exposure for vendors touching sensitive data

Requirements

You must bring deep, hands-on experience in security review and vendor/third-party risk management and be able to write structured, rubric-style feedback that an AI can learn from.

• 8+ years of experience in security review, vendor risk management, or third-party risk
• Hands-on experience evaluating SOC 2 reports, security questionnaires, and compliance evidence
• Proven ability to judge evidence quality, scope mismatches, and bridge-letter issues
• Strong structured writing skills for rubric-style feedback and golden responses
• CISSP, CISA, or equivalent certification is a plus
• Prior task-writing, rubric-authoring, or AI-training data experience preferred

Who should apply

Experienced security reviewers, vendor-risk managers, procurement security specialists, and compliance professionals who enjoy translating expert decisions into clear, repeatable rubrics should apply.

This role is ideal for practitioners who want to contribute their domain expertise to cutting-edge AI training while working flexibly as a contractor.

• You enjoy close reading of technical evidence and explaining judgement precisely
• You can work independently and meet deadlines while maintaining consistent annotation quality
• You are located in the United States, Canada, or Mexico and fluent in English

Compensation & schedule

Pay is hourly at a competitive rate aligned to your experience: $90–$110 USD per hour. The role requires at least 20 hours per week and is contracted through OpenTrain AI.

No benefits beyond contract pay are implied; this is contractor work and scheduling is flexible within the 20+ hour weekly expectation.

• Hourly rate: $90–$110 USD per hour (PAY_PER_HOUR)
• Minimum weekly commitment: 20+ hours
• Eligible locations: US, CA, MX (English required)