About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Portuguese AI Response Evaluation Expert to review AI-generated responses, evaluate reasoning quality, and provide expert feedback so outputs are accurate, logical, and clearly explained. The work includes assessing solutions for accuracy, clarity, and adherence to the prompt, identifying errors in methodology or conceptual understanding, fact-checking information, writing high-quality explanations and model solutions, and rating multiple AI responses based on correctness and reasoning quality. Strong Portuguese localization and translation judgment is important for maintaining correct terminology, tone, and cultural nuance across use cases.
What you will do
- Review AI-generated responses and language outputs for accuracy, logic, and clarity.
- Evaluate step-by-step problem solving, methodology, and conceptual understanding.
- Fact-check names, dates, units, references, and other localized details.
- Write high-quality explanations and model solutions when needed.
- Compare multiple AI responses and judge their correctness and reasoning quality.
- Apply Portuguese localization and translation judgment to preserve terminology, tone, and cultural nuance.
Required skills
- Degree in Translation, Linguistics, Localization, Communications, or a related field.
- Fluent Portuguese proficiency.
- C1 English reading and writing proficiency.
- 5+ years of localization or translation experience.
- MQM/LQA knowledge, CAT tools, and QA workflow experience.
- Excellent editorial judgment and strong fact-checking skills.
- Experience with AI data training, annotation, or evaluation is preferred.
Helpful background
- Familiarity with terminology management, translation memory, termbases, automated checks, style guides, and copyediting.
- Responsiveness, clear documentation, and dependable hourly contractor work habits.
Additional details
- Hourly contractor role
- Fully remote
- Based in Brazil
- Up to $30/hour