Skip to content
OpenTrain AIOpenTrain AIOpenTrain AIDocs

Ask OpenTrain

Answers from the documentation, with sources.

What would you like to do with OpenTrain?

AI answers can be mistaken. Check the linked sources. Don’t include private account information.

Open app

OPENTRAIN AI DOCUMENTATION

Forms and quizzes

Build native forms and quizzes in OpenTrain, assign published versions to AI trainers as Project To-dos, and review responses, scores, and results.

OpenTrain includes a native form and quiz builder so you can run onboarding checks, knowledge quizzes, and information-gathering forms without linking out to an external tool. You build and publish a form once, assign a published version to AI trainers as a Project To-do on a job, and review every response inside OpenTrain.

Use forms and quizzes when you need to:

  • Verify that AI trainers understood project instructions before they start work.
  • Run a graded qualification quiz with a pass threshold and limited attempts.
  • Collect structured information, such as tooling access or availability, from everyone on a project.

Forms and quizzes assigned as Project To-dos are for AI trainers you have already hired. To quiz every applicant before you hire, put the quiz in a course and link it to the job as an application screening quiz.

Open Forms from the employer dashboard sidebar. The library lists every form in your organization with its current state:

  • Draft — the form has never been published. Only you and your team can see it.
  • Published vN — the form has at least one published version. The badge shows the latest version number.
  • Archived — the form no longer accepts new attempts. Published versions and response history stay unchanged.

From the library you can create a new form, Duplicate an existing form into a fresh draft, or Archive a form you no longer use. Use the status filter to find archived forms later.

Click New form to open the builder. Add questions from these types:

Question typeAnswer format
Short answerA single line of text
ParagraphLonger free text
Multiple choiceOne option from a list
CheckboxesOne or more options from a list
DropdownOne option from a dropdown list
Linear scaleA point on a numeric scale with optional end labels
NumberA numeric value
DateA calendar date

You can also insert Section and Title blocks to group questions and add explanatory text between them. Each answerable question can be marked required.

Every answerable question has a Graded toggle:

  • Graded questions carry a point value and an answer key. Multiple choice, checkboxes, and dropdown questions grade against the correct option or options. Short answer questions grade against an expected text value. Linear scale, number, and date questions grade against an expected value. OpenTrain scores graded answers automatically on submission.
  • Information questions have no answer key and no points. Use them for surveys and data collection. A form with no graded questions behaves as a pure information form.

Questions can also be set for manual grading, where you award points yourself after reviewing the answer. The builder shows the total scored points for the form as you add grading.

The builder autosaves your draft as you edit and shows the save status next to the form title. You can leave the builder and come back without losing work. Autosave applies to drafts only; it never changes a published version.

Before publishing, set how attempts and results behave:

  • Attempts — allow unlimited attempts, or limit the number of attempts per AI trainer. New forms default to 1 attempt; new quizzes default to 2.
  • Pass rule — optionally require a minimum score, either as a percentage of total points or as an absolute point threshold. A form with a pass rule behaves as a quiz with pass and fail outcomes. Leave the pass rule off for information forms.
  • Result release — choose Immediately after submission to show AI trainers their score as soon as OpenTrain grades the attempt, or Manually by employer to hold scores until you release them from the results page.

Click Publish to create a published version of the form. Published versions are immutable:

  • Each publish creates a new numbered version (v1, v2, and so on).
  • Editing the form after publishing changes only the draft. Your edits do not affect any published version until you publish again.
  • Assignments always pin one exact published version, so AI trainers who are mid-attempt never see the form change underneath them.

Use Preview to walk through the form exactly as an AI trainer will see it before you publish or assign it.

Forms reach AI trainers through Project To-dos on a job:

  1. Open the job and enable Project To-dos in the job Settings tab if you have not already. See Project To-dos.
  2. Create a new to-do and choose the OpenTrain form or quiz completion method.
  3. Select a published form version. The picker shows each version’s attempt policy and pass rule so you can confirm you are assigning the right one. If the form is still a draft, publish it first.
  4. Choose the completion policy for the to-do:
Completion policyThe to-do completes when
Complete when submittedThe AI trainer submits the form. Best for information gathering; the score does not affect the to-do.
Complete when passedThe AI trainer passes the quiz. Available only when the form has a pass rule and no manually graded questions. A failed attempt stays open while a retake is available.
Complete after employer reviewYou review the response and approve the to-do from the review queue.

Like other Project To-dos, you choose exactly who the to-do targets (everyone on the project, future hires, or specific people), the due date, and whether it blocks project work. Assigned AI trainers get a notification, and OpenTrain sends reminders as the due date approaches.

Open Results on a form to review responses across all assignments of its published versions:

  • Summary cards show aggregate numbers, including how many attempts still need review.
  • The attempts table lists each submission with its score and a Released or Private result status.
  • Open an individual response to review every answer, award points for manually graded questions, and, for manually released forms, release the result to the AI trainer.
  • Click Export CSV to download all attempts for offline analysis.

If the form uses manual result release, AI trainers see that their submission is saved but do not see their score until you release it. Releasing a result notifies the AI trainer.

To require a corrected attempt, return the submission with feedback. Returning grants exactly one extra attempt on the same published version, and the AI trainer sees your reason. The to-do reopens until the retake is submitted.

Agents can author forms, assign quizzes with a safe preview step, grade, release results, and grant retakes through the developer surface. Start with the quiz surface reference.