AI Response Evaluator (English Language Expert)

You will evaluate AI-generated English content for accuracy, clarity, naturalness, reasoning quality, and adherence to prompts. You will also create prompts, write strong example responses, revise model outputs, and explain corrections clearly.

The work includes guided conversations about everyday situations such as shopping, customer support, and appointments. After each scenario, you will assess the AI response and give concise feedback on problems such as ambiguity, bias, meaning drift, unsupported claims, awkward wording, and reasoning errors.

• Review and compare multiple AI responses using criteria such as correctness, fluency, relevance, naturalness, and discourse effectiveness.
• Write prompts, responses, explanations, and revisions that demonstrate accurate language and sound methods.
• Fact-check information when needed and identify inaccuracies, inconsistent reasoning, bias, and shifts in meaning.
• Assess guided speech-based conversations for accuracy, relevance, politeness, clarity, and task completion.
• Apply rubrics and task guidelines consistently across different content and use cases.

The work requires strong English language judgment and careful written explanations.

• Up to $20 to $25 per hour.
• 20+ hours per week.
• Bachelor's degree or higher in Linguistics, English, Translation or Localization, Communications, Journalism, or a related discipline.
• At least C1 English proficiency; C2 or professional command is preferred.
• Strong knowledge of grammar, syntax, semantics, pragmatics, discourse structure, and stylistic editing across registers.
• Ability to identify subtle errors, ambiguity, inconsistencies, bias, and meaning shifts, then explain corrections clearly in writing.
• Experience with style guides and consistency in tone, terminology, punctuation, and capitalization.