Scenario in benchmark · Version 1

The user asks the quiz to test a particular learning goal

The user asks for a quiz to test a stated learning goal that requires explaining an idea or relationship.

How the tools performed

Every in-scope tool is visible. Outcomes come from current published Results for this scenario and benchmark version.

Publication availability: 1 tool has a current published Result.

No published result does not tell you whether a tool has been tested. Test coverage is shown only for comparable published Results.

ToolPublished outcomesTest coverageResult
Published Results · alphabetical, not ranked
Quizgecko
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
1 of 1 assessed1 of 1 gradableView Result →
No published result · alphabetical
DoctoQuiz——No published result
Edcafe AI——No published result
GPT-5.6 terra——No published result
Knowt——No published result
PDF to Quiz——No published result
QuestionWell——No published result
Quizizz——No published result
QuizRise——No published result
Studyglen——No published result

Assessed = Pass + Fail + Not gradable. Gradable = Pass + Fail. Both use the published Result’s pinned-test denominator. — means not publicly available.

Test design

Pinned test cases
1
Disclosure
0 public · 1 withheld
Capabilities exercised here
Quiz Generation

What this scenario evaluates

  • Whether the assessment is centred on explaining the specified idea or relationship rather than only recognising facts.
  • Whether the product provides answer or evaluation criteria that cover the required elements of a complete explanation.
  • Whether the response can be judged against those required elements in a way that matches the stated learning goal.

Exact wording, inputs, fixture state, expected output and detailed grading remain at the test-case level and may be withheld while the benchmark version is active. The scenario and its evaluation intent are public.

How the results are graded

  • Pass: the test-case expectations hold.
  • Fail: an expectation demonstrably does not hold.
  • Not gradable: the evidence cannot establish the outcome.

Version 1 uses test-case expectations; no scenario rubric is pinned.

Benchmark methodology →
The user asks the quiz to test a particular learning goal in Quiz Generation | AI Demos