The answer needs a summary and its detail together
When an answer needs both an overall summary and supporting detail, the system presents both together.
What this scenario means
This scenario tests whether the system can choose a combined presentation when one form is not enough. A good agent gives the overall answer and the supporting detail together, instead of collapsing everything into one view or forcing a second request.
What we evaluate
- Whether it presents both the overall summary and the supporting detail in one reply.
- Whether it keeps the summary and the supporting detail aligned.
- Whether it uses forms suited to each part instead of forcing a single form.
- Whether it still answers the same underlying question when both parts are requested together.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Answer Presentation
Decides and adjusts how the answer is represented — prose, a table, a chart, or a combination — and changes it on request.
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Database Agents
Which AI database agent answers business questions about a live relational database correctly — in the company's own terms, and honestly when the data cannot answer?