About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting a Spanish Personalized AI Response Evaluator to assess personalized conversational AI interactions. You will create multi-turn prompts grounded in personal experiences, review how naturally and accurately a model uses relevant information, and compare responses for grounding, integration, helpfulness, and overall usability. This role combines creative prompt design with careful quality judgment and written reasoning.
What you will do
Design and execute conversational prompts, typically spanning one to five turns, that test the use of personal context. Evaluate whether model responses follow the intent of each prompt and apply personalization appropriately. Identify unsupported claims, flawed inferences, hallucinations, forced connections, and unnatural over-explanation. Compare responses side by side to determine which is more helpful, easy to use, and enjoyable. Write concise, defensible rationales that reference specific conversation turns and provide constructive feedback. Verify debugging information to confirm that summaries and relevant data sources were used correctly. Maintain data hygiene by deleting evaluation conversations after review.
Required skills
Strong Spanish reading and writing ability is required. Successful contractors will bring excellent analytical thinking for nuanced or ambiguous AI responses, experience creating creative multi-turn prompts from personal context, and the ability to recognize incorrect personalization, poor inferences, and forced connections. Clear, structured written communication and careful attention to detail are essential. You should be able to work independently in a remote setting with a reliable computer and internet connection. The work also requires willingness to use a primary personal Google account and enable relevant personal data sources for evaluation.
Helpful background
A bachelor's degree or equivalent experience in policy, law, ethics, linguistics, journalism, computer science, or a related analytical field is helpful. Experience in data annotation, AI quality evaluation, content moderation, or related work is also valuable.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.