211 Specialist, Government Services AI Evaluator

You will help improve AI systems that answer questions about government services and community resources. Your work will draw on your experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.

You will judge whether questions sound like real requests from people seeking help, then assess whether AI answers are accurate, complete, current, and useful. The work is done asynchronously and includes writing clear feedback.

• Review sample questions and identify requests that do not reflect realistic caller needs.
• Write rubrics that define correct answers, suitable referrals, and useful next steps.
• Evaluate AI-generated answers against those rubrics.
• Identify errors, missing information, outdated guidance, and unhelpful responses.
• Give precise written feedback based on public-service accuracy and caller usefulness.

This is a part-time contract role for someone with practical experience answering public questions about government services, benefits, and community resources.

• Experience: At least one year of regular, high-volume public contact through phone, chat, or in-person service.
• Required background: Experience as a 211 Specialist, Information and Referral Specialist, or Benefits Navigator.
• Required knowledge: Working knowledge of public benefits and community resources.
• Required skills: Clear, precise writing and the ability to judge whether guidance is complete and actionable.