You will create realistic case studies based on ground combat, ground maneuver, direct action, and special-operations scenarios. You will then assess whether AI responses show sound reasoning and appropriate operational value.
The work includes reviewing how responses handle uncertainty, sources, limitations, lawful boundaries, and questions about tactical or targeting utility. You will also identify answers that improperly refuse legitimate doctrinal, conceptual, or readiness-related questions.
Scenarios should reflect real mission planning and execution rather than cinematic portrayals. You will document difficult cases and explain the reasoning behind each evaluation.
- Create and classify challenging military case studies.
- Evaluate AI-generated responses for reasoning quality and operational usefulness.
- Review uncertainty handling, source quality, limitations, and tactical relevance.
- Identify over-refusals of legitimate doctrinal, conceptual, or readiness questions.
- Document edge cases and provide clear evaluation rationale.