Evaluate AI-generated written responses for accuracy, clarity, tone, helpfulness, and instruction following. This remote contract role pays $90-$140 per hour and requires strong English writing or editorial experience.
The work
You will review several AI-generated responses to writing prompts and judge how well each one meets the prompt and its intended audience. You will record scores, explain your decisions, and identify issues that could affect the quality or reliability of the writing.
- Compare AI-generated responses with the requirements of each writing prompt.
- Score clarity, tone, helpfulness, accuracy, coherence, and instruction following.
- Find factual errors, unsupported claims, logical inconsistencies, and poor editorial or audience choices.
- Write concise rationales that make each evaluation clear and easy to review.
- Record assessments in digital content review platforms and project tools.
- Work independently within project timelines and collaborate asynchronously with project managers and reviewers.
What it pays and takes
This is a remote, part-time contractor role for people with strong written English and professional experience in writing, editing, reporting, fact-checking, or related work. AI evaluation or annotation experience is helpful but not required.
- Pay: $90-$140 USD per hour.
- Time: 20 or more hours per week.
- Language: Native or near-native written English.
- Experience: Journalism, reporting, editing, copy editing, sub-editing, fact-checking, ghostwriting, or published authorship.
- Education: A completed university degree from an institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand.
- Skills: Technical writing, critical analysis, written communication, careful fact-checking, attention to detail, and sound editorial judgment.
- Work setting: Remote, with the ability to work independently and deliver careful assessments.
- Helpful background: Annotation, AI model evaluation, or digital content review platform experience.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind systems that generate text and other content. People review model responses, rate their quality, and explain what should improve, so strong writers and editors help shape how these systems respond. OpenTrain is the hiring and contracting organization for this role, and creating an account is free.
