Benchmark methodology

Quiz Generation

The public evaluation method approved for this benchmark definition.

How the benchmark works

A public summary of the evaluation method. The same defined scope and evidence standard apply to every tool assessed under this version.

Scope

Scope includes quizzes and practice tests

The benchmark covers quizzes and practice tests from supplied study material, then delivering, grading, explaining, and tracking them.

Method boundary

Open rubrics and scoring

Rubrics, weights, scoring, and ranking methodology remain open and unpinned.

Separate attributes

Product attributes are separate

Product attributes are captured separately and never scored.

Class reports

Class reports show struggle, not trend

Class reports cover what the class struggled with; do not invent an over-time class-performance trend.

Test case implementation and fixture design remain the open stage.

Quiz Generation methodology | AI Demos