Linguistics Evaluation Specialist

The work

You will review conversations between people and large language models. Your evaluations will help improve how AI systems understand language, follow instructions, and respond in context.

You will use written guidelines to assess model responses and record clear findings. You will also work with project coordinators to clarify unclear instructions or evaluation cases.

• Review conversation transcripts for accuracy, clarity, and completeness.
• Assess whether language model responses follow the provided instructions and guidelines.
• Find subtle grammar, language-use, and context errors.
• Give detailed written and verbal feedback on response quality.
• Write organized reports with findings and recommendations.
• Help clarify evaluation guidelines when they are ambiguous.

What it pays and takes

This is a part-time contractor role for a language model evaluation project. No previous AI experience is required, but strong linguistics knowledge and careful language analysis are essential.

• Pay: $40 to $50 USD per hour.
• Time: At least 20 hours per week.
• Location: You must be based in one of the listed eligible countries.
• Language: Native proficiency in U.S. English.
• Background: Advanced academic training or extensive professional experience in linguistics, language analysis, or a related field.
• Strengths: Excellent written communication, nuanced language judgment, and close attention to detail.
• Availability: Able to begin contributing immediately upon selection.
• Preferred: Experience evaluating work against guidelines or rubrics, plus the ability to provide written and verbal insights.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

OpenTrain AI is the hiring and contracting organization for this role. AI training work uses human reviews, examples, and feedback to help artificial intelligence systems produce more accurate and useful results, and linguistics specialists are paid for the language expertise needed to judge subtle differences in meaning and quality.