About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a Linguistic Model Evaluation Expert to create and assess language analysis scenarios used to evaluate AI model judgment. You will apply specialist knowledge across syntax, semantics, phonology, morphology, sociolinguistics, psycholinguistics, or related areas to produce rigorous evaluation data and explain where model reasoning succeeds or fails.
What you will do
You will author scenarios that test real linguistic analysis, including syntactic ambiguity, semantic entailment, and phonological patterns. You will write reference analyses that explain the evidence, generalizations, exceptions, and reasoning behind each judgment. You will grade model outputs for analytical accuracy and honest handling of linguistic data, flagging responses that misparse a sentence or misidentify the phenomenon.
Required skills
You should have an advanced degree in linguistics or a closely related field and at least two years of research, teaching, or applied linguistics experience. Depth in a linguistic subfield such as syntax, semantics, phonology, morphology, sociolinguistics, or psycholinguistics is required. Strong written English is necessary for clear technical analysis, along with the ability to explain judgments and identify what would falsify an analysis.
Helpful background
PhD-level training, peer-reviewed publications, computational linguistics or corpus-methods experience, and fieldwork or documentation of understudied languages are helpful for this work.
Schedule and pay
This is ongoing, fully remote, asynchronous contractor work. You must be available for at least 10 hours per week, with no maximum and flexibility to scale your workload up or down. Compensation is $50 to $100 per hour, paid weekly via Stripe.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.