Hebrew-English AI Response Evaluator

The Work

You will review bilingual AI-generated content and create training examples that show accurate, clear, natural, and instruction-following responses. The work focuses on Hebrew language quality, reasoning, facts, and cultural context.

• Review Hebrew and English AI responses for accuracy, clarity, fluency, and adherence to the prompt.
• Evaluate step-by-step reasoning and identify methodological, conceptual, or explanatory gaps.
• Fact-check claims and validate information with reputable sources when task guidelines require it.
• Write detailed prompts, model solutions, and explanations that demonstrate correct methods.
• Rate and compare responses for correctness, reasoning quality, context, and language quality.
• Check for inaccuracies, bias, meaning drift, and other reliability issues across different use cases.

What It Pays and Takes

This is a part-time contractor role for candidates working from Israel. The role is listed as entry level, but the requirements include at least three years of relevant experience.

• Pay: Up to $50 per hour; rates may vary by project variant.
• Hours: 20 or more hours per week.
• Work arrangement: Fully remote, with flexible work-from-anywhere hours and independent asynchronous collaboration.
• Location: Israel.
• Languages: Native or near-native Hebrew and at least C1 English.
• Education: Bachelor's degree or higher in linguistics, translation, Hebrew language, communications, journalism, or a related field.
• Experience: At least three years in translation, localization, editorial quality assurance, content quality, or linguistic review.
• Skills: Strong formal and informal Hebrew writing and editing, careful attention to detail, and consistent use of detailed evaluation rubrics.
• You must be able to recognize reasoning gaps and methodological errors even when the writing is fluent.
• Helpful background: Experience with AI training, annotation, or evaluation workflows, plus familiarity with Israeli cultural context and terminology in news, education, consumer, and technology topics.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that generate text and other content. Reviewers assess model outputs, correct mistakes, and create examples that help AI produce more accurate, useful, and natural responses.