Cybersecurity AI Evaluation Expert
Use your cybersecurity leadership experience to design realistic AI evaluation tasks, reference outputs, and expert rubrics for security operations, incident response, and risk management.
Posted Aug 7, 2026
Lead red-team evaluation for AI security: design offensive-evaluation frameworks, safe proxy tasks, and scoring rubrics. Remote contractor role, 20+ hrs/week, $50–$90/hr; requires 5+ years in offensive security, red teaming, or vulnerability research.
Generative AI & RLHF
$50–$90/hr
Compensation
Worldwide
Eligibility
Entry
Experience
Jul 3, 2026
Posted
Open worldwide
OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. We help people discover projects, build a unified portfolio, and grow durable freelance careers teaching AI. Creating an OpenTrain account is free.
AI training (data labeling and human evaluation) is the human side of building intelligent systems. Contributors create, evaluate, and refine the examples and tests that shape model behavior — including offensive and defensive security evaluations that help models resist misuse.
This role focuses on offensive cyber work used to evaluate and harden AI systems: designing safe proxy tasks, scoring attacker sophistication, and documenting findings so models and engineering teams can improve security posture.
OpenTrain is recruiting a Red Team Lead to design and validate offensive-security evaluation work that supports AI training and model evaluation. You will develop cyber-capability taxonomies, create safe proxy attack tasks, produce scoring rubrics, review red-team benchmarks, and write clear technical documentation for both technical and non-technical audiences.
This is a remote contractor, part-time role with a minimum commitment of 20+ hours per week. Work is asynchronous and worldwide; English proficiency is required.
Candidates must preserve safety and ethics while working on adversarial security tasks. OpenTrain expects rigorous handling of sensitive subject matter and adherence to agreed boundaries and controls.
This project involves text-based evaluation tasks used for RLHF and structured evaluation ratings. You will produce frameworks, rubrics, and documentation rather than executing real-world attacks. All work must follow ethical safeguards and project-specific constraints.
Apply if you are an experienced offensive security professional who wants to shape how AI systems are tested and hardened. This is ideal for practitioners who enjoy writing clear methods, building benchmarks, and collaborating remotely on safety-focused work.
To apply, create an OpenTrain account, complete your profile, and submit your application for the Red Team Lead role. OpenTrain will manage contracting and project details; selected contributors will work asynchronously and deliver frameworks, tests, and documentation according to project milestones.
Keep exploring
Use your cybersecurity leadership experience to design realistic AI evaluation tasks, reference outputs, and expert rubrics for security operations, incident response, and risk management.
Posted Aug 7, 2026
Join OpenTrain AI to red-team large language models and agents, building reproducible attack tests, automation, and security tooling. Part-time remote work for certified cybersecurity professionals with strong scripting and pentesting experience, flexible hours, pay up to $55/hr.
Posted Nov 17, 2025
Probe conversational AI for jailbreaks, prompt injections, and misuse as a remote AI Safety Red Team Specialist for OpenTrain. Contractor, part-time role (20+ hrs/week) paying $24–$35/hr; native English and Thai required.
Posted Jul 30, 2026
Browse related job pages
Expertise
Languages