Handles an 84-page mixed-content annual report end-to-end and reaches SUCCESS in the Results view without manual correction.
What was measured
Complex Document Handling
Maintains quality across long, multi-section, and mixed-content documents without degradation.
decisive for this rankingtransformation
The subject explicitly says complex PDF, so sustained quality across long, mixed-content documents is central to the tool’s ability to do the job. (3 of 3 judges)
What was given, what came back
Test input: Hybrid Earnings Report · pdf · group: hybrid-earnings-report
Input — what we sent
A long, real-world hybrid annual report used to benchmark end-to-end PDF-to-markdown conversion. It combines native text, financial tables, charts/graphics, and scanned signature/stamp regions, stressing preservation of document structure, reading order, and embedded visual content across a multi-section report.
Why this input is hard
- · Native digital text extraction
- · Complex financial table preservation
- · Chart and graphic retention
- · Image-based signatures and stamps
- · Reading order across a long multi-section report
- · Markdown quality and consistency
Output — unretouched
Loading file...
Also checked on this input — same tool, 5 other criteria
Reading Order & Structure✓ WorkedKeeps the report's heading-and-paragraph sequence intact instead of flattening the page into disconnected text blocks.Table Preservation✓ WorkedPreserves aligned rows, columns, and value associations in a standard multi-year financial summary table.Text & OCR Completeness✓ WorkedRecovers a blurred signature stamp as readable text, showing OCR can salvage low-quality scanned text rather than dropping it entirely.Visual Content Retention◐ MixedConverts a waterfall chart into a text/table representation, preserving the SG&A rate sequence and deltas but not the chart as a visual object.Visual Content Retention◐ MixedRepresents logos and signatures as textual placeholders or descriptions rather than retaining them as image assets in the output.
Provenance
- Observation
- 067d4ba1-ae97-4111-b551-af220e9d5046
- Evidence run
- 6e3160de-fe46-4b45-b071-72560b5c5d0e
- Study
- Convert a Complex PDF into Clean Markdown with an API
- Research task
- 86b9h7t37
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "llamaparse",
scenario: "hybrid-earnings-report"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 8 other tools
measured on Complex Document Handling
Adobe API✓ WorkedProcesses a long mixed-content annual report in one automated run, keeping tables, charts, and scanned signature pages in the extracted output.Extend AI✓ WorkedProcesses an 84-page hybrid annual report end-to-end across native text, tables, charts, and scan-only signature regions without manual cleanup.Mistral AI✓ WorkedThe tool handles an 84-page mixed-content annual report end-to-end, including tables, charts, and scanned signature/stamp regions, and returns usable markdown output without manual correction.Nutrient.io✓ WorkedHandles an 84-page mixed-content annual report end to end, including native text, tables, charts, and scanned signature pages, and returns a markdown export.PDFVector✓ WorkedHandled an 84-page hybrid annual report without errors.Reducto◐ MixedProcesses the full 84-page mixed-content report in 25.5 seconds with no truncation and keeps the hardest nested table’s 27 values exact, but 10 footer numbers are corrupted in the back two-thirds of the file.Tensorlake✓ WorkedProcesses an 84-page mixed-content annual report without collapsing the hierarchy, keeping text, tables, charts, and scanned signatures usable within the extracted workflow.Upstage AI◐ MixedHandles an 84-page hybrid report end to end, but quality degrades on signatures and multicolumn pages rather than staying uniform across the document.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com