Linguistics AI Evaluation Expert

Help improve how AI systems handle specialized linguistic reasoning by creating expert-level problems and reviewing model responses.

• Design challenging linguistics problems and scenarios based on real analytical, corpus, and computational workflows.
• Rate AI-generated responses for accuracy, analytical rigor, and fit with professional linguistic practice.
• Write clear, structured feedback that identifies weaknesses and explains how responses can improve.
• Explain complex linguistic ideas precisely in writing.

• Hours: 20+ hours per week. This is part-time, project-based work with no set schedule; complete tasks at your own pace.
• Work authorization: German work authorization is required.
• Education and expertise: A PhD or MS in Linguistics or Computational Linguistics, or comparable evidence of advanced subject expertise.
• Research: Publications and experience studying a language or linguistic phenomenon that AI systems handle poorly.
• Skills: Strong written communication and the ability to work independently in a remote, asynchronous setting.
• Language: English.