You will help train and evaluate AI systems on professional risk management tasks. The work involves judging whether AI responses are correct, well-reasoned, clear, complete, practical, and aligned with the prompt.
You will review risk assessments, control mappings, mitigation plans, risk communications, and incident response scenarios. You will also fact-check risk and compliance concepts, identify unsafe or misleading recommendations, and write explanations that show the right approach.
- Review and rank AI responses on risk topics using correctness, rigor, clarity, and practical usefulness.
- Create detailed prompts and gold-standard answers for risk assessments, control mappings, mitigation plans, and risk communications.
- Test model outputs for inaccurate information, misleading certainty, bias, and weak reasoning.
- Write precise feedback to improve model behavior and answer quality.