Linguistics AI Evaluation Expert

Use your linguistics expertise to create challenging problems and evaluate AI-generated responses. Work asynchronously, using independent judgment to provide feedback that can improve model performance.

• Create expert-level problems based on linguistic analysis, corpus methods, and computational workflows.
• Assess responses for technical accuracy, analytical rigor, and fit with real linguistic practice.
• Write clear, structured feedback that explains weaknesses.

• Hours: 20+ hours per week. The work is part-time, flexible, and has no set schedule.
• Language: Fluency in English.
• Education: A PhD or MS in Linguistics or Computational Linguistics is requested. Candidates who meet at least two core qualifications are also encouraged to contribute.
• Research: Publications and expertise in a language or linguistic phenomenon that AI models handle poorly.
• Knowledge: Advanced knowledge in areas such as morphology, syntax, phonology, formal grammars, corpus methods, low-resource languages, phonetics, or computational and NLP tools.
• Skills: Strong writing, attention to detail, and the ability to explain complex linguistic ideas clearly.