SHIP Medicare Counselor for AI Evaluation

You will help evaluate AI systems that answer Medicare questions. The work uses your counseling judgment to assess whether questions reflect real beneficiary concerns and whether answers are accurate, complete, useful, and current.

• Review sample Medicare questions and identify prompts that do not reflect realistic beneficiary concerns.
• Create rubrics for answers about initial enrollment, special enrollment periods, and Part B late enrollment penalties.
• Write guidance for comparing Medigap, Medicare Advantage, and Part D plans, including key differences and appropriate use cases.
• Evaluate AI-generated answers against your rubrics and flag errors, missing information, and outdated guidance.
• Provide clear written feedback asynchronously.

This is a remote, short-term contractor project for candidates in the United States. The project requires 20 to 30 hours per week.

• Experience: Active or recent SHIP certification, or prior Medicare enrollment experience with the Social Security Administration.
• Experience: At least one year advising on initial enrollment, special enrollment periods, Part B late enrollment penalties, Medigap versus Medicare Advantage, and Part D.
• Skills: Clear, precise writing and the ability to explain Medicare guidance accurately.
• Language: Professional fluency in English.