Security Engineer, Cybersecurity AI Evaluation

You will help improve large language models by creating cybersecurity prompts and judging how well the models respond. Your reviews should reflect practical security engineering or offensive security knowledge.

The work is remote and asynchronous. Project assignments may vary across cybersecurity evaluation activities.

• Create prompts that test cybersecurity knowledge in realistic security scenarios.
• Evaluate AI responses for quality, accuracy, and cybersecurity relevance.
• Use practical judgment from security engineering or offensive security work.
• Contribute independently in an asynchronous remote workflow.

What it pays and takes

• Pay: Up to $80 per hour for qualifying project work.
• Schedule: 20+ hours per week with flexible participation.
• Location: Open to candidates in the United States.
• Language: Fluency in English.
• Experience: At least three years of professional experience in security engineering or offensive security.
• Relevant backgrounds include penetration testing, red teaming, malware analysis, threat hunting, threat intelligence, vulnerability research, and security consulting.
• Tools: Hands-on experience with one or more of Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat.
• Skills: Ability to write cybersecurity prompts and make informed judgments about AI-generated responses.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples. Contributors write prompts, review model responses, and provide ratings that help make AI more accurate and useful. OpenTrain is a platform where people find AI training and data-labeling roles, build a profile, and apply to projects.