The table output is selective rather than exhaustive: the report says it covers only selected parts of the chapter and does not comprehensively cover the whole chapter.
What was measured
Summary Output Quality
How well the tool turns source material into structured, exam-ready summaries instead of plain paragraph compression.
decisive for this rankingtransformation
The main job here is producing structured, exam-ready notes rather than generic compression, so summary quality directly determines whether the tool succeeds. (3 of 3 judges)
What was given, what came back
Test input: Long academic chapter PDF for exam-ready notes · pdf
Input — what we sent
A long academic chapter PDF used to test whether tools can turn dense study material into structured, exam-ready revision notes with source traceability and active recall support.
Why this input is hard
- · Long-document PDF processing
- · Structured summarization into bullets/tables/sections
- · Preserving academic clarity and key concepts
- · Generating flashcards and quiz questions
- · Source verification and jump-to-source traceability
- · Revision-friendly formatting and workflow support
Output — unretouched
No output artifact
The verdict rests on the tester's written observation alone — no file was captured for this cell.
Also checked on this input — same tool, 6 other criteria
Active Recall Support◐ MixedThe flashcard set can repeat items occasionally, which the report flags as a quality limitation.Active Recall Support⚠ StruggledQuiz volume is low for a full chapter: the report says around 10–12 MCQs were generated and that this is insufficient for exam prep at chapter scale.Active Recall Support✓ WorkedProduces a 12-question multiple-choice quiz with immediate correctness feedback and explanations; the UI shows 1/12 and the correct option is marked in green.Active Recall Support✓ WorkedGenerates a large flashcard deck for active recall; the UI shows 1/70 and the report says the chapter produced 65+ flashcards, with flip navigation, answer reveal, and Good/Bad content feedback.Study Material Handling✓ WorkedProcessed a 36-page academic PDF end-to-end and began generating multiple output formats simultaneously, showing it can ingest a long study chapter without manual splitting.Traceability & Transparency✓ WorkedLinks generated notes back to the source with numbered citations like [1], and the report says those references jump to the exact page and paragraph in the original PDF.
Provenance
- Observation
- cf4f006e-44de-4f90-bacc-ee6d55d479e4
- Evidence run
- 17ca9a9c-03d4-402e-b34d-2ea8078316be
- Study
- Turn Academic PDFs Into Exam-Ready Revision Notes Using AI
- Research task
- 86b8anp1v
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- observed
- Proof shown
- input only
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "notebooklm"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 4 other tools
measured on Summary Output Quality
GPAI✓ WorkedConverts dense chapter content into structured exam notes with bullet points, bold topic headings, and section separation instead of plain paragraph compression.NoteGPT⚠ StruggledOn mixed text-and-diagram input, it leaves diagram content out of Smart Summary, AI Notes, and Mind Maps and provides no separate diagram explanation.StudyFetch✓ WorkedThe tool offers Standard, Detailed, and Comprehensive summary modes, and Comprehensive explicitly adds tables plus a structured breakdown for maximum structure and full clarity.YouLearn AI✓ WorkedProduces exam-oriented summaries in structured and tabular form, and its cheat-sheet mode extracts key terms, core definitions, essential highlights, and flowchart-style explanations.
This evidence is published in
From the same study (page rebuilt from a later run)
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com