FutureSmart Document Intelligence in Structured Document Extraction
Scenario-level performance from current published Results.
9 scenarios with published Results · 19 scenarios in the benchmark
How FutureSmart Document Intelligence performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.
Field Extraction5 scenarios · 3 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The value is directly available | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence correctly read a plainly labelled scalar field that was directly available in ordinary digital text. It returned receipt_number as "RHS-70234" in its JSON output, and the product panel showed the same value with the correct text type. The receipt number was the single value, and the visible totals also matched the source receipt. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value must be derived | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence correctly derived the value from present inputs. The output returned total_fuel_cost 81 for distance_miles 450 and fuel_rate__per_mile 0.18, and the string "81" does not appear anywhere in the three-page source. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value needs a supplied definition | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence returned the consignment reference, not the more prominent invoice number, when the supplied definition said which field counted. It output `reference_number = CFS-CN-40821` from the invoice, matching the value identified by the definition and not the prominent candidate. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The field is absent | No published result | ||
| The same field across layouts | No published result | ||
Nested & Repeated Fields4 scenarios · 3 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A repeated set of records | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence correctly extracted a repeated set of records from the invoice, with the three line items bound to the right records. It matched the source on description, quantity, unit price, amount, and GBP currency. A delivery note on page 2 yielded no extractable text in this pass, so that page’s contents were not visible here. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set continues across a page break | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence returned one ordered line_items array of ten objects across the page break, with no duplicate at the boundary and no second array. The visible proof showed items 1-4 in the first frame and items 5-10 in the later screenshot. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set is legitimately empty | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedThe empty set was represented as an empty array, not as an invented member. FutureSmart Document Intelligence returned `damage_exceptions: []` in the exported JSON, while the card view omitted that empty field; the evidence supports a clean empty-set result with no extra row added. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set contains a non-record | No published result | ||
OCR2 scenarios · 2 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence correctly extracted the expected structured values from a cleanly scanned document. The scanned twin had no recoverable text layer, and the tool returned the invoice number, site, line items, subtotal, VAT, and total due matching the digital version. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A document mixing digital and scanned pages | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence processed the scanned page inside a mixed digital-and-scanned PDF instead of skipping it. It returned all five requested values, including the scanned-page vehicle registration and recipient name, and the digital references and total due matched the document. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Querying3 scenarios · 1 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Aggregate across documents | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedFutureSmart Document Intelligence returned the correct total when values had to be aggregated across documents. It answered £10,327.64 and separately reported Blackwood £6,591.24, Thistlewood £1,754.40, and Coppergate Wholesale £1,982.00. Those figures reconcile to the total shown in the screenshot, and the checked run did not show a refusal. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Filter records across documents | No published result | ||
| The answer was never in the schema | No published result | ||
Review and Correction3 scenarios · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Correct a field value | No published result | ||
| Corrected data goes downstream | No published result | ||
| Repair a record | No published result | ||
Source Grounding2 scenarios · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | No published result | ||
| Trace a value to its location | No published result | ||
Training1 scenario · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A field the tool can only get right from examples | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Inventory is not testing progress
The 19 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for FutureSmart Document Intelligence.