You will help evaluate AI systems that handle cyber threat intelligence. The work focuses on distinguishing legitimate defensive analysis from impermissible surveillance, attribution, or intrusion-related requests.
You will combine structured evaluation, boundary-case writing, and expert feedback on AI-generated threat assessments.
- Map cyber threat intelligence cases to established taxonomies.
- Write boundary cases covering prohibited surveillance, attribution, and intrusion-adjacent requests.
- Evaluate and grade AI-generated threat responses.
- Assess source reliability, analytic reasoning, stated limitations, and actionable utility.
- Identify unnecessary over-refusal and document difficult cases involving nation-state operations and advanced threats.
- Give concise written and spoken feedback to improve AI threat assessment capabilities.
What it pays and takes
This is a remote, part-time contractor role. The position is listed as entry level, and the work requires strong subject-matter expertise in cyber threat intelligence.
- Pay: $70 to $110 per hour.
- Work arrangement: Remote contractor, part time.
- Location: Open to candidates in the countries specified for this role across the Americas, Europe, Asia, Africa, and the Middle East.
- Language: Strong written and spoken English.
- Experience: Substantial experience with nation-state operations or advanced cyber threats.
- Knowledge: Threat-actor attribution, APT tracking, or adversary tactics and techniques.
- Judgment: Ability to separate legitimate defensive and analytic work from impermissible offensive or surveillance-focused requests.
- Communication: Strong structured writing and verbal communication, plus experience mentoring, teaching, or leading threat intelligence professionals.
- Helpful but not required: Prior AI evaluation, red-teaming, or related quality assurance experience.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 6 screening questions.
About AI training work
AI training is the human work behind systems that learn from examples, including rating responses and reviewing model outputs. Subject-matter experts are needed to judge difficult cases, explain what a strong answer should contain, and help make AI systems more accurate and safer.