About OpenTrain
OpenTrain is the centralized, open platform where AI training and data-labeling freelancers find work, consolidate opportunities across platforms, and build a unified AI training portfolio they control. We make specialized AI training work easier to track, apply for, and grow into a durable freelance career.
About this role
OpenTrain is recruiting for a Social Services AI Evaluation Expert to help improve AI systems that handle sensitive human-services situations. You will assess case notes, resource guidance, support communications, and AI-generated responses for accuracy, empathy, appropriate boundaries, confidentiality, and safety. The work combines professional social-services judgment with careful feedback for AI training datasets.
What you will do
You will evaluate real-world case notes, resource guidance, and support communications using your direct-service experience. You will review AI-generated intake summaries, referral suggestions, care-plan language, and responses to people in difficult situations. You will create realistic, fully anonymized scenarios without real names, case details, or identifying information. You will identify risks and gaps in how AI handles sensitive and emotionally difficult situations, document findings clearly, and provide actionable recommendations for improving model behavior and training data.
Required skills
You should be currently employed full time in a direct-service role such as social worker, case worker, community health worker, family or youth services worker, or counselor. At least two years of professional experience in social or community services is required. You should have strong judgment on sensitive topics, a clear understanding of confidentiality, and excellent written and verbal communication skills, including the ability to explain reasoning clearly.
Helpful background
A BSW, MSW, equivalent degree, or professional license is helpful. Experience in child welfare, health care, housing, or schools is also valuable, as is familiarity with AI, automation, or digital tools used in human services.
Work arrangement
This is remote contractor work for professionals located in the United States or Canada. The expected rate range is $20‑$80 per hour. The role applies domain expertise to hands-on AI evaluation and dataset development, with an emphasis on safe, respectful, and well-reasoned handling of sensitive situations.
Why work with OpenTrain
OpenTrain gives freelancers one place to manage AI training opportunities instead of rebuilding proof of work on every platform. A stronger OpenTrain profile helps you show credible experience, discover roles that match your skills, and turn AI training and data-labeling work into a long-term portfolio.
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 5 screening questions.