Skip to content
OpenTrain AIFor AI Companies

Linguistics AI Evaluation Expert

Apply now

Job details

Pay

$80 USD/hr

Engagement

Contract

Location

Remote

United States only

Posted

Nov 5, 2026

OpenTrain on Trustpilot

The work

About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.

About this role
OpenTrain is recruiting for a project-based Linguistics AI Evaluation Expert role supporting the development of better language models. You will use practical expertise in linguistic analysis, corpus methods, and computational or NLP workflows to create challenging problems, assess AI-generated responses, and provide feedback grounded in how linguistics is practiced. The work is flexible and can be completed alongside another role.

What you will do
- Create expert-level linguistics problems and scenarios based on analytical, corpus, and computational workflows.
- Evaluate AI-generated responses for technical accuracy, analytical rigor, and alignment with real linguistic practice.
- Write structured feedback that identifies weaknesses and helps improve AI model performance.
- Apply independent judgment while completing asynchronous project tasks at your own pace.

Required skills
- Research experience demonstrated through publications and expertise in a language or linguistic phenomenon that AI models handle poorly.
- A PhD or MS in Linguistics or Computational Linguistics. Candidates who meet at least two core qualifications are also encouraged to contribute.
- Advanced knowledge in morphology, syntax, phonology, formal grammars, corpus methods, low-resource languages, phonetics, or computational and NLP tooling.
- Strong written communication, attention to detail, and the ability to explain complex linguistic concepts clearly.
- US work authorization and the ability to work independently in a remote, asynchronous setting.

Helpful background
Experience with Praat, IPA, computational or NLP tooling, corpus analysis software, low-resource languages, or typologically diverse languages can strengthen your contribution. The role is suited to practitioners who can connect formal linguistic knowledge with concrete analytical workflows and distinguish technically sound model responses from flawed ones.

Work arrangement and pay
This is ongoing, flexible, part-time contract work with no set schedule or minimum hour requirement. Tasks can be taken on alongside a current role. Compensation is advertised at up to $80 per hour.

Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.

Requirements

  • Languages: English

Open to applicants in

  • United States

How to apply

  1. Apply here on OpenTrain. You create a free account, and we send you to the hiring platform.
  2. Complete your application on the hiring platform.

OpenTrain on Trustpilot

Job ID: cmw3tuzu000io08l3xyjaymbv

Keep exploring

Similar open roles

View all AI training jobs

Linguistic Model Evaluation Expert

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · United Arab Emirates, Antigua and Barbuda, Albania +92 more
English
Flexible hours
Hourly · $50–$100/hr

Posted Nov 6, 2026

AI Evaluator

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

EnglishAttention to DetailAI UsageGoogle ClassroomLiterature
Text
Remote · United States
English
Part-time · Flexible
Hourly · $15–$40/hr

Posted Oct 8, 2026

Language Expert (Mandarin)

Review and compare AI responses, fact-check localized content, and write model solutions as a Mandarin Language Expert. This part-time contract offers 20+ hours per week and up to $40 per hour.

Cat toolsChineseCopyeditingEnglishLinguistic QALocalization
Generative AI & RLHF
Text
Remote · Australia, Cambodia, Canada +18 more
Chinese, English
Part-time · Flexible
Intermediate level
Hourly · $40/hr

Posted Jul 9, 2026

Language Expert (English)

Review and rank AI-generated English responses, write prompts and corrections, and assess guided conversations. This remote contract role offers up to $20 to $25 per hour and requires 20+ hours weekly.

CopyeditingDiscourse analysisEnglishGrammarLocalizationMultilingual communication
Generative AI & RLHF
Text
Remote · Australia, Austria, Belgium +24 more
English
Part-time · Flexible
Hourly · $20–$25/hr

Posted Jul 8, 2026

Linguistics AI Evaluation Expert (Germany)

About OpenTrain OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control.…

Text
Remote · Germany
English
Flexible hours
Hourly · $65/hr

Posted Nov 5, 2026