About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About This Role
Complete the application on the hiring site for this role. In this role, you will review AI-generated safety evaluations, adversarial prompts, risk analyses, and trainer or QA submissions, then provide precise written feedback against project guidelines and rubrics. You will assess adversarial reasoning, policy awareness, safety taxonomy alignment, scenario realism, vulnerability coverage, formatting, instruction-following, and rubric adherence while identifying recurring quality issues and helping keep remote contributors aligned.
What You Will Do
- Review adversarial prompts, model responses, risk classifications, safety analyses, policy explanations, and vulnerability reports for accuracy, realism, and usefulness.
- Spot-check trainer and QA submissions, escalate recurring issues, and reinforce quality standards across projects.
- Communicate updates, workflow changes, and review expectations to trainers and QAs in remote collaboration channels.
- Support onboarding, documentation, FAQs, trackers, calibration tasks, and process improvements.
- Help manage contributor activation and follow-up when team members are inactive or not working consistently.
Required Skills
- Strong English communication skills and excellent attention to detail.
- Experience in AI safety, red-teaming, cybersecurity, trust and safety, content policy, risk analysis, model evaluation, content moderation, or related workflows.
- Familiarity with adversarial prompting, jailbreak patterns, harmful-content taxonomies, misuse scenarios, policy interpretation, and safety evaluation principles.
- Comfort evaluating work against detailed rubrics and leading or supporting remote teams.
- Experience with tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, or project management systems.
Helpful Background
- Background in Computer Science, Cybersecurity, AI Safety, Trust & Safety, Public Policy, Psychology, Linguistics, Law, Security Studies, or Risk Analysis.
- Experience with AI training, LLM evaluation, safety evaluations, content moderation QA, policy QA, or rubric-based review.
- Familiarity with prompt injection, social engineering, cybersecurity abuse, fraud, self-harm safety, extremist content, misinformation, privacy risk, illicit behavior, bias, and model refusal behavior.
Pay and Work Setup
- Hourly contract role
- Up to 100/hour
- Remote
- United States hiring
Why This Work Matters
This role supports the quality of safety training data used to improve leading AI models. Strong red-teaming QA helps ensure that safety-focused datasets are realistic, nuanced, policy-aligned, well-documented, and useful for identifying model vulnerabilities.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.