Skip to content
OpenTrain AIFor AI Companies

Intelligence Analyst, AI Model Evaluation

Apply now

Job details

Pay

$80–$170 USD/hr

Engagement

Contract, part-time

Location

Remote

52 countries

Posted

Oct 23, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for an Intelligence Analyst, AI Model Evaluation role focused on improving how advanced AI systems handle government and defense analysis. You will apply intelligence tradecraft and professional judgment to realistic model outputs, helping assess whether responses use sources appropriately, reason rigorously, express uncertainty responsibly, and remain useful for operational contexts. The work centers on expert review of AI-generated military and government reports and related evaluation materials. This is a remote contractor engagement with a target rate of $80‑$170 per hour.

What you will do
Develop and map analytic cases to defined taxonomies across multiple intelligence evaluation areas. Author complex test cases that examine source handling, analytic rigor, uncertainty expression, and practical utility. Assess and grade AI-generated responses against criteria for reasoning, source use, limitations, and usefulness. Identify over-refusal when a model declines legitimate analytic exploration, then document the issue clearly. Record edge cases and analytic disagreements to support stronger evaluation methods. Collaborate with project leads to refine source-evaluation procedures and confidence-level assignment. Contribute expert insights that calibrate analytic standards and improve AI benchmarks.

Required skills
Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline. Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards. Familiarity with structured analytic techniques and intelligence tradecraft standards. Ability to identify and explain nuanced model limitations and over-refusal scenarios. Exceptional written and verbal communication, with a focus on clarity and precision. Experience teaching, mentoring, or leading analytic reviews is valuable.

Helpful background
Previous participation in AI evaluation or model assessment initiatives is helpful, but prior AI experience is not required. A civilian intelligence community background or comparable government and defense analysis experience can provide useful context for the work.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.

The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 8 screening questions.

Requirements

  • Languages: English
  • Skills: Analytic rigor, Source handling, Over-refusal detection, All-Source Intelligence Analysis

Open to applicants in

  • Algeria
  • Argentina
  • Austria
  • Bahrain
  • Bangladesh
  • Belgium
  • Brazil
  • Canada
  • Chile
  • Colombia
  • Denmark
  • Egypt
  • France
  • Germany
  • Ghana
  • Greece
  • India
  • Indonesia
  • Italy
  • Japan
  • Jordan
  • Kazakhstan
  • Kenya
  • Kuwait
  • Kyrgyzstan
  • Lebanon
  • Malaysia
  • Mexico
  • Morocco
  • Netherlands
  • Nigeria
  • Oman
  • Pakistan
  • Palestine
  • Peru
  • Philippines
  • Portugal
  • Qatar
  • Saudi Arabia
  • Singapore
  • South Africa
  • Spain
  • Sri Lanka
  • Switzerland
  • Taiwan
  • Thailand
  • Tunisia
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmvldtwoh003508jpvg3zuxf2

Keep exploring

Similar open roles

View all AI training jobs

Military Intelligence AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

military intelligence analysisthreat assessmentoperational planninganalytical methodologiescritical thinkinganalytical writing
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $50–$100/hr

Posted Nov 17, 2026

Civilian Intelligence Agency AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

intelligence analysisprogram managementorganizational decision-makingcybersecuritystrategic planningscenario evaluation
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Mid-Senior level
Hourly · $80–$170/hr

Posted Oct 30, 2026

AI Model Evaluation Trainer

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Video AnnotationAttention to DetailData LabelingVideo Annotation ToolsTime Management
Text
Remote · Germany
English
Part-time · Flexible
Intermediate level
Hourly · $14–$36/hr

Posted Sep 23, 2026

Investment Banking Analyst - AI Model Evaluation

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Critical ThinkingProblem Solving
Text
Remote · Worldwide
English
Flexible hours
Hourly · $100/hr

Posted Nov 6, 2026

Finance AI Model Evaluation Analyst

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Critical ThinkingProblem Solving
Text
Remote · Worldwide
English
Flexible hours
Hourly · $100/hr

Posted Jul 16, 2026