Defense and Intelligence Specialists (AI Evaluation)

You will review realistic defense and intelligence scenarios and assess whether AI responses are accurate, appropriate, and properly limited. Your feedback will help clarify what an AI model should and should not produce in high-stakes situations.

The work covers policy review, operational planning, readiness, evidence analysis, surveillance and reconnaissance, targeting, and related topics. Use only published doctrine, open literature, open-source reporting, and your general professional judgment.

You will work remotely and asynchronously, completing projects independently at your own pace.

• Review defense and intelligence scenarios involving operational and policy questions.
• Evaluate AI responses for accuracy, appropriateness, and proper boundaries.
• Identify responses that wrongly refuse legitimate requests or provide assistance that should be declined.
• Document recommended changes and provide structured written feedback.
• Never share classified or restricted information.

This is an ongoing, project-based contract opportunity that can be completed alongside another role. The work is open to candidates in the United States and requires professional fluency in English.

• Work arrangement: Remote and asynchronous, with no set schedule or minimum hour requirement.
• Experience: At least three years in a defense, military, or intelligence role.
• Relevant backgrounds: Operations, intelligence analysis, targeting, surveillance and reconnaissance, readiness and logistics, or defense policy.
• Knowledge: Military doctrine, operational planning, intelligence collection and analysis, open-source intelligence, targeting, surveillance and reconnaissance, or defense policy and rules of engagement.
• Skills: Clear written communication, sound judgment, attention to detail, and the ability to work independently.
• Information standard: Use only publicly available information and never share classified or restricted material.