Landing AI in Structured Document Extraction
Scenario-level performance from current published Results.
12 scenarios with published Results · 19 scenarios in the benchmark
How Landing AI performed
Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.
Field Extraction5 scenarios · 3 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The same field across layouts | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario. It returned the correct owed amount from three documents with different layouts: $90.10 from the receipt, $227.33 from the invoice, and USD 157.50 from the other receipt. The screenshots show each value highlighted in the viewer and the same single String field in the schema. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value must be derived | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI derived the requested value in this scenario. The invoice shows DISTANCE 450 miles and FUEL RATE £0.18 per mile; the JSON returns fuel_cost as GBP 81.00, and the document text does not contain 81.00. The playground screen shows the same result beside a one-field schema. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The value is directly available | No published result | ||
| The value needs a supplied definition | No published result | ||
Nested & Repeated Fields4 scenarios · 4 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A repeated set of records | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI extracted the repeated set of records in this run. The invoice table on page 3 returned three line items with the correct values and pairing; the delivery note says there were three lines and six units, and the schema asked for description and amount only. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set contains a non-record | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI left the non-record out of the extracted set in the tested invoice. The output contained five members, matching the five numbered rows, and it did not include the separate Total row or its 1,982.00 amount. The schema description shown in the capture was neutral. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set continues across a page break | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI kept the repeated set in one array when the data crossed a page break. In the checked case, ten line items appeared in document order with no duplicate at the boundary, and the results panel showed the array opening once and closing once. No other case is reported here. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The set is legitimately empty | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI returned an empty set when the document said there were none this period. In the checked PDF page, the source text said no damage or exceptions were reported, and the export showed an empty array. The schema pane showed the field as a required array, and the output did not turn the marker text into a member. | 1/1 assessed1/1 gradablePublished test set | View Result → |
OCR2 scenarios · 2 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A cleanly scanned document | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI produced accurate text for the scanned-document case tested here. The digital invoice and its image-only twin returned the same three values: invoice_number TPH-3301, invoice_date 10 March 2026, and total_due £1,754.40. The twin file is shown with zero extractable characters, and the gap was none. No other test case has a result yet. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| A document mixing digital and scanned pages | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI failed this mixed PDF scenario: it returned the scanned-page values and the digital line items correctly, but total_due came back as “#1,246.80” instead of “£1,246.80”. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Querying3 scenarios · 3 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Aggregate across documents | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI failed to total values across every document in the project. The shown schema returned each file's own total instead of one cross-document total, and chat replied that it could not find the answer in the provided document. Blackwood showed £6,591.24 and HIS-4402 showed £1,246.80; Thistlewood is shown as outdated under the current schema. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Filter records across documents | 0 Pass1 Fail0 Not gradable 1 of 1 test case failedWhat happenedLanding AI did not filter records across the document set in this test. The chat reply said it could not find the answer in the provided document, and the results were shown one file at a time. The extracted values still matched their source invoices. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| The answer was never in the schema | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI answered a document question outside the extraction schema and tied the answer to the source document. In the invoice test, it returned 06 Jul 2020 for the due date and showed a visual reference to the row containing that value. A second wording returned the same attributed answer. | 1/1 assessed1/1 gradablePublished test set | View Result → |
Source Grounding2 scenarios · 1 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| The field is absent | 1 Pass0 Fail0 Not gradable 1 of 1 test case passedWhat happenedLanding AI passed this scenario by returning an honest null for the absent field. The metadata showed no source range for that field. The receipt number was returned as RHS-70234, with a source range shown in the metadata. | 1/1 assessed1/1 gradablePublished test set | View Result → |
| Trace a value to its location | No published result | ||
Review and Correction3 scenarios · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| Correct a field value | No published result | ||
| Corrected data goes downstream | No published result | ||
| Repair a record | No published result | ||
Training1 scenario · 0 with published Results
Capability in this benchmark →
| Scenario | Published outcomes | Test coverage | Result |
|---|---|---|---|
| A field the tool can only get right from examples | No published result | ||
Reading these Results
Published evidence and test coverage answer different questions.
Which scenarios have a Result?
A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.
What does each Result cover?
Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.
Inventory is not testing progress
The 19 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for Landing AI.