OPENTRAIN AI DOCUMENTATION
Forms and quizzes
Build native forms and quizzes in OpenTrain, assign published versions to AI trainers as Project To-dos, and review responses, scores, and results.
OpenTrain includes a native form and quiz builder so you can run onboarding checks, knowledge quizzes, and information-gathering forms without linking out to an external tool. You build and publish a form once, assign a published version to AI trainers as a Project To-do on a job, and review every response inside OpenTrain.
Use forms and quizzes when you need to:
- Verify that AI trainers understood project instructions before they start work.
- Run a graded qualification quiz with a pass threshold and limited attempts.
- Collect structured information, such as tooling access or availability, from everyone on a project.
Forms and quizzes assigned as Project To-dos are for AI trainers you have already hired. To quiz every applicant before you hire, put the quiz in a course and link it to the job as an application screening quiz.
Open the Forms library
Section titled “Open the Forms library”Open Forms from the employer dashboard sidebar. The library lists every form in your organization with its current state:
- Draft — the form has never been published. Only you and your team can see it.
- Published vN — the form has at least one published version. The badge shows the latest version number.
- Archived — the form no longer accepts new attempts. Published versions and response history stay unchanged.
From the library you can create a new form, Duplicate an existing form into a fresh draft, or Archive a form you no longer use. Use the status filter to find archived forms later.
Build a form
Section titled “Build a form”Click New form to open the builder. Add questions from these types:
| Question type | Answer format |
|---|---|
| Short answer | A single line of text |
| Paragraph | Longer free text |
| Multiple choice | One option from a list |
| Checkboxes | One or more options from a list |
| Dropdown | One option from a dropdown list |
| Linear scale | A point on a numeric scale with optional end labels |
| Number | A numeric value |
| Date | A calendar date |
You can also insert Section and Title blocks to group questions and add explanatory text between them. Each answerable question can be marked required.
Graded and information questions
Section titled “Graded and information questions”Every answerable question has a Graded toggle:
- Graded questions carry a point value and an answer key. Multiple choice, checkboxes, and dropdown questions grade against the correct option or options. Short answer questions grade against an expected text value. Linear scale, number, and date questions grade against an expected value. OpenTrain scores graded answers automatically on submission.
- Information questions have no answer key and no points. Use them for surveys and data collection. A form with no graded questions behaves as a pure information form.
Questions can also be set for manual grading, where you award points yourself after reviewing the answer. The builder shows the total scored points for the form as you add grading.
Drafts autosave
Section titled “Drafts autosave”The builder autosaves your draft as you edit and shows the save status next to the form title. You can leave the builder and come back without losing work. Autosave applies to drafts only; it never changes a published version.
Form settings
Section titled “Form settings”Before publishing, set how attempts and results behave:
- Attempts — allow unlimited attempts, or limit the number of attempts per AI trainer. New forms default to 1 attempt; new quizzes default to 2.
- Pass rule — optionally require a minimum score, either as a percentage of total points or as an absolute point threshold. A form with a pass rule behaves as a quiz with pass and fail outcomes. Leave the pass rule off for information forms.
- Result release — choose Immediately after submission to show AI trainers their score as soon as OpenTrain grades the attempt, or Manually by employer to hold scores until you release them from the results page.
Publish and version
Section titled “Publish and version”Click Publish to create a published version of the form. Published versions are immutable:
- Each publish creates a new numbered version (v1, v2, and so on).
- Editing the form after publishing changes only the draft. Your edits do not affect any published version until you publish again.
- Assignments always pin one exact published version, so AI trainers who are mid-attempt never see the form change underneath them.
Use Preview to walk through the form exactly as an AI trainer will see it before you publish or assign it.
Assign a form as a Project To-do
Section titled “Assign a form as a Project To-do”Forms reach AI trainers through Project To-dos on a job:
- Open the job and enable Project To-dos in the job Settings tab if you have not already. See Project To-dos.
- Create a new to-do and choose the OpenTrain form or quiz completion method.
- Select a published form version. The picker shows each version’s attempt policy and pass rule so you can confirm you are assigning the right one. If the form is still a draft, publish it first.
- Choose the completion policy for the to-do:
| Completion policy | The to-do completes when |
|---|---|
| Complete when submitted | The AI trainer submits the form. Best for information gathering; the score does not affect the to-do. |
| Complete when passed | The AI trainer passes the quiz. Available only when the form has a pass rule and no manually graded questions. A failed attempt stays open while a retake is available. |
| Complete after employer review | You review the response and approve the to-do from the review queue. |
Like other Project To-dos, you choose exactly who the to-do targets (everyone on the project, future hires, or specific people), the due date, and whether it blocks project work. Assigned AI trainers get a notification, and OpenTrain sends reminders as the due date approaches.
Review results
Section titled “Review results”Open Results on a form to review responses across all assignments of its published versions:
- Summary cards show aggregate numbers, including how many attempts still need review.
- The attempts table lists each submission with its score and a Released or Private result status.
- Open an individual response to review every answer, award points for manually graded questions, and, for manually released forms, release the result to the AI trainer.
- Click Export CSV to download all attempts for offline analysis.
If the form uses manual result release, AI trainers see that their submission is saved but do not see their score until you release it. Releasing a result notifies the AI trainer.
Grant a retake
Section titled “Grant a retake”To require a corrected attempt, return the submission with feedback. Returning grants exactly one extra attempt on the same published version, and the AI trainer sees your reason. The to-do reopens until the retake is submitted.
Automate with the API, CLI, or MCP
Section titled “Automate with the API, CLI, or MCP”Agents can author forms, assign quizzes with a safe preview step, grade, release results, and grant retakes through the developer surface. Start with the quiz surface reference.
Related pages
Section titled “Related pages”- Project To-dos — the assignment, review, and tracking workflow this page builds on.
- Hire and manage contracts — the post-hire job workspace.
- Complete project to-dos — how AI trainers complete an assigned form or quiz.