Skip to content
OpenTrain AIFor AI Companies

Linguistic Model Evaluation Expert

Apply now

Job details

Pay

$50–$100 USD/hr

Engagement

Contract

Location

Remote

95 countries

Posted

Nov 6, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting a Linguistic Model Evaluation Expert to create and assess language analysis scenarios used to evaluate AI model judgment. You will apply specialist knowledge across syntax, semantics, phonology, morphology, sociolinguistics, psycholinguistics, or related areas to produce rigorous evaluation data and explain where model reasoning succeeds or fails.

What you will do
You will author scenarios that test real linguistic analysis, including syntactic ambiguity, semantic entailment, and phonological patterns. You will write reference analyses that explain the evidence, generalizations, exceptions, and reasoning behind each judgment. You will grade model outputs for analytical accuracy and honest handling of linguistic data, flagging responses that misparse a sentence or misidentify the phenomenon.

Required skills
You should have an advanced degree in linguistics or a closely related field and at least two years of research, teaching, or applied linguistics experience. Depth in a linguistic subfield such as syntax, semantics, phonology, morphology, sociolinguistics, or psycholinguistics is required. Strong written English is necessary for clear technical analysis, along with the ability to explain judgments and identify what would falsify an analysis.

Helpful background
PhD-level training, peer-reviewed publications, computational linguistics or corpus-methods experience, and fieldwork or documentation of understudied languages are helpful for this work.

Schedule and pay
This is ongoing, fully remote, asynchronous contractor work. You must be available for at least 10 hours per week, with no maximum and flexibility to scale your workload up or down. Compensation is $50 to $100 per hour, paid weekly via Stripe.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • Albania
  • Algeria
  • Antigua and Barbuda
  • Armenia
  • Australia
  • Austria
  • Bahamas
  • Bahrain
  • Belgium
  • Benin
  • Bhutan
  • Bosnia and Herzegovina
  • Botswana
  • Brunei
  • Bulgaria
  • Canada
  • Costa Rica
  • Côte d’Ivoire
  • Croatia
  • Cyprus
  • Czechia
  • Denmark
  • Ecuador
  • El Salvador
  • Estonia
  • Ethiopia
  • Finland
  • France
  • Gambia
  • Germany
  • Greece
  • Guatemala
  • Guyana
  • Hong Kong
  • Hungary
  • Iceland
  • India
  • Indonesia
  • Ireland
  • Israel
  • Italy
  • Jamaica
  • Jordan
  • Kenya
  • Kuwait
  • Latvia
  • Liechtenstein
  • Lithuania
  • Luxembourg
  • Madagascar
  • Malaysia
  • Malta
  • Mauritius
  • Mexico
  • Moldova
  • Mongolia
  • Morocco
  • Mozambique
  • Namibia
  • Netherlands
  • New Zealand
  • North Macedonia
  • Norway
  • Oman
  • Pakistan
  • Panama
  • Peru
  • Philippines
  • Poland
  • Portugal
  • Qatar
  • Romania
  • Rwanda
  • Saint Lucia
  • Senegal
  • Serbia
  • Singapore
  • Slovakia
  • Slovenia
  • South Africa
  • Spain
  • Sri Lanka
  • Sweden
  • Switzerland
  • Taiwan
  • Tanzania
  • Thailand
  • Trinidad and Tobago
  • Tunisia
  • Türkiye
  • United Arab Emirates
  • United Kingdom
  • United States
  • Uzbekistan
  • Vietnam

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw53r3nv00ay08l2ehpuhf49

Keep exploring

Similar open roles

View all AI training jobs

ML Engineer, LLM and Agentic Evaluations

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

PythonLLM
Text
Remote · India, Pakistan, Türkiye
English
Part-time · Flexible

Posted Nov 18, 2026

Linguistics AI Evaluation Expert (Germany)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · Germany
English
Flexible hours
Hourly · $65/hr

Posted Nov 5, 2026

Linguistics AI Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 5, 2026

Linguistics AI Evaluation Expert (India)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · India
English
Flexible hours
Hourly · $47/hr

Posted Nov 5, 2026

Audio Language Evaluation Expert (Mexico)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Audio
Remote · Mexico
Spanish, English
Part-time · Flexible
Hourly · $30–$65/hr

Posted Oct 8, 2026