Capability in benchmark · Version 1

Field Extraction

Returns the scalar fields the schema asks for — present, interpreted, derived, absent or differently laid out — correctly typed

5 scenarios · 7 current published Results · 3 tools with published Results

How the tools performed

Explore current published Results across this capability’s scenarios. Open a scenario to compare its tools, or a Result to inspect the evidence.

Each cell reports its own published test set. There is no combined capability score or claim that different Results used identical tests.

Scenarios in this capability
Tools with published Results appear first, alphabetically. Remaining participants stay visible below.
Participating toolThe value is directly available →The value needs a supplied definition →The value must be derived →The same field across layouts →The field is absent →
FutureSmart Document IntelligenceThe value is directly available →
1 Pass
1/1 assessed1/1 gradableView Result →
The value needs a supplied definition →
1 Pass
1/1 assessed1/1 gradableView Result →
The value must be derived →
1 Pass
1/1 assessed1/1 gradableView Result →
The same field across layouts →No published resultThe field is absent →No published result
Landing AIThe value is directly available →No published resultThe value needs a supplied definition →No published resultThe value must be derived →
1 Pass
1/1 assessed1/1 gradableView Result →
The same field across layouts →
1 Pass
1/1 assessed1/1 gradableView Result →
The field is absent →
1 Pass
1/1 assessed1/1 gradableView Result →
NanonetsThe value is directly available →No published resultThe value needs a supplied definition →No published resultThe value must be derived →
1 Pass
1/1 assessed1/1 gradableView Result →
The same field across layouts →No published resultThe field is absent →No published result
DatalabNo published result across these scenarios
DocsumoNo published result across these scenarios
Extend AINo published result across these scenarios
LlamaParseNo published result across these scenarios
ReductoNo published result across these scenarios
RetabNo published result across these scenarios
UnstractNo published result across these scenarios

Reading the comparison

Publication availability and test coverage describe different things.

Published evidence

Publication is not testing progress

“No published result” says only that there is no current public Result. It does not indicate whether a tool has been tested, passed, failed or is applicable.

Test coverage

Read each Result’s test set

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Each fraction uses the pinned tests in that same published Result.

Go deeper

Choose the view you need

A scenario compares tools on one situation. A tool page follows one tool across this benchmark. A Result explains the outcome and shows the evidence.

Field Extraction in Structured Document Extraction | AI Demos