AI Claims Evaluation and Quality Analyst (Remote, United States)
Evaluated AI-generated auto insurance claim decisions for coverage accuracy, policy alignment, reasoning quality, payout logic, and compliance risk. Designed FNOL test scenarios with deliberate contradictions and decoy documents to probe model robustness and failure modes. Graded model outputs using structured reason codes and created answer keys with expected outcomes and policy references. • Assessed reasoning for late reporting, recently purchased policy scenarios, inconsistent damage, prior loss indicators, and SIU referral triggers • Produced structured evaluation notes including negligence and recovery likelihood along with calculation notes • Tested robustness via outdated forms, inconsistent timelines, and missing evidence • Documented rubric-based results to support QA auditing and quality consistency