Tool in benchmark · Version 1

FutureSmart Document Intelligence in Structured Document Extraction

Scenario-level performance from current published Results.

9 scenarios with published Results · 19 scenarios in the benchmark

How FutureSmart Document Intelligence performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.

Field Extraction5 scenarios · 3 with published Results
ScenarioPublished outcomesTest coverageResult
The value is directly available
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence correctly read a plainly labelled scalar field that was directly available in ordinary digital text. It returned receipt_number as "RHS-70234" in its JSON output, and the product panel showed the same value with the correct text type. The receipt number was the single value, and the visible totals also matched the source receipt.

1/1 assessed1/1 gradablePublished test setView Result →
The value must be derived
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence correctly derived the value from present inputs. The output returned total_fuel_cost 81 for distance_miles 450 and fuel_rate__per_mile 0.18, and the string "81" does not appear anywhere in the three-page source.

1/1 assessed1/1 gradablePublished test setView Result →
The value needs a supplied definition
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence returned the consignment reference, not the more prominent invoice number, when the supplied definition said which field counted. It output `reference_number = CFS-CN-40821` from the invoice, matching the value identified by the definition and not the prominent candidate.

1/1 assessed1/1 gradablePublished test setView Result →
The field is absentNo published result
The same field across layoutsNo published result
Nested & Repeated Fields4 scenarios · 3 with published Results
ScenarioPublished outcomesTest coverageResult
A repeated set of records
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence correctly extracted a repeated set of records from the invoice, with the three line items bound to the right records. It matched the source on description, quantity, unit price, amount, and GBP currency. A delivery note on page 2 yielded no extractable text in this pass, so that page’s contents were not visible here.

1/1 assessed1/1 gradablePublished test setView Result →
The set continues across a page break
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence returned one ordered line_items array of ten objects across the page break, with no duplicate at the boundary and no second array. The visible proof showed items 1-4 in the first frame and items 5-10 in the later screenshot.

1/1 assessed1/1 gradablePublished test setView Result →
The set is legitimately empty
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

The empty set was represented as an empty array, not as an invented member. FutureSmart Document Intelligence returned `damage_exceptions: []` in the exported JSON, while the card view omitted that empty field; the evidence supports a clean empty-set result with no extra row added.

1/1 assessed1/1 gradablePublished test setView Result →
The set contains a non-recordNo published result
OCR2 scenarios · 2 with published Results
ScenarioPublished outcomesTest coverageResult
A cleanly scanned document
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence correctly extracted the expected structured values from a cleanly scanned document. The scanned twin had no recoverable text layer, and the tool returned the invoice number, site, line items, subtotal, VAT, and total due matching the digital version.

1/1 assessed1/1 gradablePublished test setView Result →
A document mixing digital and scanned pages
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence processed the scanned page inside a mixed digital-and-scanned PDF instead of skipping it. It returned all five requested values, including the scanned-page vehicle registration and recipient name, and the digital references and total due matched the document.

1/1 assessed1/1 gradablePublished test setView Result →
Querying3 scenarios · 1 with published Results
ScenarioPublished outcomesTest coverageResult
Aggregate across documents
1 Pass0 Fail0 Not gradable
1 of 1 test case passed
What happened

FutureSmart Document Intelligence returned the correct total when values had to be aggregated across documents. It answered £10,327.64 and separately reported Blackwood £6,591.24, Thistlewood £1,754.40, and Coppergate Wholesale £1,982.00. Those figures reconcile to the total shown in the screenshot, and the checked run did not show a refusal.

1/1 assessed1/1 gradablePublished test setView Result →
Filter records across documentsNo published result
The answer was never in the schemaNo published result
Review and Correction3 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
Correct a field valueNo published result
Corrected data goes downstreamNo published result
Repair a recordNo published result
Source Grounding2 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
The field is absentNo published result
Trace a value to its locationNo published result
Training1 scenario · 0 with published Results
ScenarioPublished outcomesTest coverageResult
A field the tool can only get right from examplesNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Inventory is not testing progress

The 19 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for FutureSmart Document Intelligence.

FutureSmart Document Intelligence in Structured Document Extraction | AI Demos