Skip to content
OpenTrain AIFor AI Companies

Software Security Engineering Manager, AI Model Evaluation

Apply now

Job details

Engagement

Contract, part-time

Location

Remote

Worldwide

Posted

Nov 13, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a Software Security AI Training Engineering Manager to lead security-focused training and evaluation work for frontier AI coding models. You will own delivery, quality, and capacity across multiple pods while ensuring vulnerability-based tasks are technically accurate, reproducible, resistant to gaming, and aligned with evaluation goals. This role combines software security expertise, people leadership, client communication, delivery management, and data-driven capacity planning.

What you will do
You will plan batches, assign work to Pod Leads, and track throughput against delivery targets. You will review security tasks as the final quality gate, calibrate Pod Leads on CWE classification, verifier robustness, task quality, and difficulty, and monitor volume, quality, timelines, risks, dependencies, tooling issues, rate limits, and safety blocks. You will lead progress reporting, coordinate scope and delivery changes, forecast staffing needs using throughput and workload data, and use dashboards and operational metrics to guide decisions. You will also mentor technical contributors and support the development of high-performing team members into Pod Lead responsibilities.

Required skills
Candidates should have approximately 10 years of overall software security engineering experience and experience leading technical teams against measurable delivery, quality, and schedule targets. Strong knowledge of CWE, CVE, and the OWASP Top 10 across programming languages and software ecosystems is required. You should have experience reproducing vulnerabilities, reviewing security patches, evaluating proof-of-vulnerability tests, and designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environments. Strong proficiency in at least one major programming language, such as Python, JavaScript or TypeScript, Java, C or C++, C#, Go, Rust, Ruby, PHP, Kotlin, or Swift, is expected. Working experience with Git, Linux, Bash, Docker, and common software security tooling is also required, along with clear communication, strong organization, and the ability to manage multiple pods and delivery phases.

Helpful background
Experience using dashboards, throughput metrics, quality data, and operational reports to make staffing and delivery decisions is valuable. The ability to communicate technical risks and project status clearly to clients and internal stakeholders will support success in this role.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open worldwide

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmwff9srv004x08l5lna1kt9q

Keep exploring

Similar open roles

View all AI training jobs

Principal Cybersecurity Expert

About OpenTrain OpenTrain is the unified marketplace where AI training freelancers find and consolidate opportunities across platforms, build an AI training portfolio, and turn specialized knowledge into a durable freel…

Cyber Security
Text
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 20, 2026

Product Security Engineer (AI Security)

Build AI-powered security systems that find vulnerabilities, detect fraud, and support automated fixes across software, infrastructure, and AI workloads. Earn $86.54 to $110.58 per hour with a 20+ hour weekly commitment.

AI & SecurityApp Security ToolingLLM SecurityProgramming Proficiency
Coding & Software
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Flexible hours
Hourly · $86.54–$110.58/hr

Posted Nov 19, 2026

GenAI Security Evaluation Engineer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Cyber SecurityLLMCode ReviewsCode Analysis
Code
Remote · Worldwide
English
Part-time · Flexible

Posted Nov 10, 2026

Senior Backend Engineer for AI Code Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonJavaScriptJavaC++Rust
Code
Remote · United States
English
Part-time · Flexible

Posted Nov 6, 2026