Skip to content
OpenTrain AIFor AI Companies

Linguistics Expert (AI Response Evaluation)

Apply now

Job details

Pay

$80 USD/hr

Engagement

Contract

Location

Remote

United States only

Posted

Nov 5, 2026

OpenTrain on Trustpilot

The work

You will help improve language models by applying practical expertise in linguistic analysis, corpus methods, and computational or NLP workflows. The work is project-based, asynchronous, and can be completed alongside another role.

  • Create expert-level linguistics problems and scenarios using analytical, corpus, and computational workflows.
  • Evaluate AI-generated responses for technical accuracy, analytical rigor, and alignment with real linguistic practice.
  • Write structured feedback that identifies weaknesses and helps improve model performance.
  • Use independent judgment while completing project tasks at your own pace.

Requirements

The role is suited to practitioners who can connect formal linguistic knowledge with practical analytical workflows.

  • Work arrangement: Part-time contract work with no set schedule or minimum hour requirement.
  • Research: Demonstrated research experience through publications and expertise in a language or linguistic phenomenon that AI models handle poorly.
  • Education: A PhD or MS in Linguistics or Computational Linguistics is required; candidates who meet at least two core qualifications are also encouraged to contribute.
  • Knowledge: Advanced knowledge of morphology, syntax, phonology, formal grammars, corpus methods, low-resource languages, phonetics, or computational and NLP tooling.
  • Skills: Strong written communication, careful attention to detail, and the ability to explain complex linguistic concepts clearly.
  • Languages: English

Open to applicants in

  • United States

Preferred

  • Helpful experience: Praat, IPA, computational or NLP tooling, corpus analysis software, low-resource languages, or typologically diverse languages.

How to apply

  1. Press Apply now. You create a free OpenTrain account and add your resume.
  2. Finish your application on the hiring company's site. The company decides who it hires, so it runs its own form.

OpenTrain on Trustpilot

Job ID: cmw3tuzu000io08l3xyjaymbv

Keep exploring

Similar open roles

View all AI training jobs

Trade Compliance Expert AI Evaluator

Use trade compliance expertise to create expert tasks, assess AI-generated answers, and give clear feedback on reporting, export controls, sanctions, and audits. This ongoing remote role pays up to $80 per hour with no set schedule.

Generative AI & RLHF
Text
Remote · United States
English
Flexible hours
Hourly · $80/hr

Posted Nov 16, 2026

Hardware Expert AI Training Specialist

Create, solve, and evaluate rigorous hardware engineering problems for AI training from anywhere, with a flexible commitment of about 15 hours per week. Pay is $60 to $120 per hour equivalent, paid per task that meets the project specifications.

RTLHardware
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

STEM Expert for AI Problem Evaluation

Solve scientific and technical problems, use Python for calculations or simulations, and review AI-generated answers for accuracy. This flexible role offers approximately 15 hours per week and pays $60 to $120 per hour equivalent, paid per task that meets project specifications.

Biology
Generative AI & RLHF
Text
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Per task · $60–$120/hr equivalent

Posted Nov 16, 2026

AI Agent Evaluator

Test AI agents on realistic smartphone tasks such as bookings, shopping, payments, and forms. Earn $25 to $45 per hour on a flexible schedule, with each run taking about 1.5 hours.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United States
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026

AI Agent Tester

Test two AI agents on realistic tasks such as bookings, shopping, forms, and follow-ups. Record each attempt, score performance, and write clear feedback from a real user’s perspective.

ChatGPTMuseAI agentsAttention to DetailFollowing InstructionsScreen Recording
Generative AI & RLHF
Video
Remote · United Arab Emirates, Argentina, Austria +49 more
English
Part-time · Flexible
Hourly · $25–$45/hr

Posted Nov 16, 2026