AI Demos Research — the structured-intelligence platform. Every verdict on these pages opens to the execution behind it.
Graded 7 October 2026

Can AskYourDatabase add a new constraint without replacing the earlier question?

AskYourDatabase handles this narrowing case: it keeps the earlier question’s date window and adds the new Texas constraint. In the first turn, the app returned 59 orders in a 10-row preview plus a full CSV. In the follow-up, it kept the same window, returned 3 Texas orders, and those three all appear in the first turn’s 59-row CSV.

1 of 1 test case passed

Every test case in this scenario has a result.

Pass rate100%1 of 1 with a result
Coverage1 of 1test cases with a result
1PassDid everything it was expected to do.
0FailNo test case failed.
0Not gradableEvery result here could be graded.
0UntestedEvery test case in this scenario has a result.
The pass rate is a summary. The evidence is the test case below: what we sent, what we checked, what the tool returned, and the proof.

The test case

Each test case is judged on its own: Pass, Fail, Not gradable, or Untested. The scenario result above counts this row.

Narrow the same question to one regionPassEvidence
What we sent

Input 1: “Show me all orders from the last 90 days, as of September 2, 2026.”

Input 2: “Only the ones shipped to Texas.”

What the tool returned
CSV22 rows · 13 columns
idorder_numbercustomer_idstatuscategoryitem_summarytotal_amountcurrencycitystateplaced_atshipped_atdelivered_at
60292ORD-2026-010217deliveredbedding_and_rugsLinen sheet set queen — Sage591.30USDReadingPA2026-09-01T08:37:21.952Z2026-09-02T08:37:21.952Z
60260ORD-2026-010116cancelledbedding_and_rugsHand-woven area rug 8x10 — Walnut216.00USDSan JoseCA2026-08-30T17:52:21.952Znull
60128ORD-2026-01009deliveredstorage_and_organizationWoven storage baskets set of 3 — Charcoal144.00USDSan AntonioTX2026-08-30T11:11:21.952Z2026-09-01T11:11:21.952Z
60074ORD-2026-00996cancelledoutdoor_and_patioAdirondack chair — Terracotta1171.80USDTucsonAZ2026-08-30T02:24:21.952Znullnull
41290ORD-2026-00981deliveredbedding_and_rugsCotton waffle comforter king — Sand128.00USDDenverCO2026-08-28T17:15:24.195Z2026-08-31T17:15:24.195Z
60201ORD-2026-009713deliveredlightingLinen drum table lamp — Ivory (+1 more)234.50USDPortlandOR2026-08-28T01:44:21.952Z2026-08-29T01:44:21.952Z2026-08-31T01:44:21.952Z
60153ORD-2026-009611deliveredlightingLinen drum table lamp — Fog Grey227.70USDPhoenixAZ2026-08-26T23:19:21.952Z2026-08-27T23:19:21.952Z2026-09-02T23:19:21.952Z
60007ORD-2026-00953deliveredhome_decorSoy candle trio — Ivory (+2 more)284.35USDDenverCO2026-08-26T12:16:21.952Z2026-08-27T12:16:21.952Z2026-08-31T12:16:21.952Z
60100ORD-2026-00948deliveredkitchen_and_diningEnamel dutch oven 6qt — Sand211.00USDAtlantaGA2026-08-26T11:57:21.952Z2026-08-27T11:57:21.952Z
60295ORD-2026-009317deliveredstorage_and_organizationEntryway bench with cubbies — Charcoal150.29USDReadingPA2026-08-25T18:25:21.952Z2026-08-26T18:25:21.952Z2026-08-30T18:25:21.952Z
60178ORD-2026-009212cancelledoutdoor_and_patioOutdoor rug 6x9 — Ivory (+1 more)1281.67USDNashvilleTN2026-08-24T16:33:21.952Znull
60044ORD-2026-00915deliveredoutdoor_and_patioPatio bistro set 3-piece — Brass (+1 more)1806.00USDAshevilleNC2026-08-24T15:41:21.952Z2026-08-26T15:41:21.952Z
60255ORD-2026-009016deliveredoutdoor_and_patioString light set 48ft — Sand (+2 more)1586.46USDSan JoseCA2026-08-24T14:57:21.952Z2026-08-26T14:57:21.952Z
60140ORD-2026-008910deliveredbedding_and_rugsLinen sheet set queen — Ivory328.50USDAshevilleNC2026-08-22T02:05:21.952Z2026-08-24T02:05:21.952Z
60049ORD-2026-00885cancelledoutdoor_and_patioOutdoor rug 6x9 — Fog Grey (+1 more)1898.66USDColumbusOH2026-08-21T13:05:21.952Znull
60099ORD-2026-00878deliveredhome_decorSoy candle trio — Walnut69.84USDAtlantaGA2026-08-20T11:00:21.952Z2026-08-22T11:00:21.952Z2026-08-26T11:00:21.952Z
60086ORD-2026-00867deliveredfurnitureAlder bookshelf 5-tier — Brass (+2 more)1099.30USDMinneapolisMN2026-08-17T10:19:21.952Z2026-08-18T10:19:21.952Z
60264ORD-2026-008516deliveredlightingCeramic bedside lamp pair — Ivory155.99USDSan JoseCA2026-08-17T06:15:21.952Z2026-08-19T06:15:21.952Z
60104ORD-2026-00848deliveredkitchen_and_diningStoneware dinnerware set 12-piece — Walnut (+2 more)523.50USDAnn ArborMI2026-08-11T22:39:21.952Z2026-08-12T22:39:21.952Z
60022ORD-2026-00834deliveredbedding_and_rugsAspen 3-seat sofa — Charcoal (+1 more)745.47USDAustinTX2026-08-07T16:09:21.952Z2026-08-08T16:09:21.952Z2026-08-11T16:09:21.952Z
60043ORD-2026-00825deliveredhome_decorBrass picture frame 8x10 — Brass188.85USDColumbusOH2026-08-05T23:11:21.952Z2026-08-06T23:11:21.952Z
60073ORD-2026-00816deliveredlightingRattan pendant light — Sage285.90USDTucsonAZ2026-08-05T16:25:21.952Z2026-08-06T16:25:21.952Z2026-08-08T16:25:21.952Z

Copied from Proof 1 · Output file (CSV), lines 1–23 · an excerpt; the link below opens the whole file

Open the CSV file ↗
Proof 1Output file (CSV)
The downloaded 59-row CSV for turn 1, showing unique order numbers and the Texas rows.
Part of this file is printed above, under What the tool returned. Show the whole file
CSV59 rows · 13 columns
idorder_numbercustomer_idstatuscategoryitem_summarytotal_amountcurrencycitystateplaced_atshipped_atdelivered_at
60292ORD-2026-010217deliveredbedding_and_rugsLinen sheet set queen — Sage591.30USDReadingPA2026-09-01T08:37:21.952Z2026-09-02T08:37:21.952Z
60260ORD-2026-010116cancelledbedding_and_rugsHand-woven area rug 8x10 — Walnut216.00USDSan JoseCA2026-08-30T17:52:21.952Znull
60128ORD-2026-01009deliveredstorage_and_organizationWoven storage baskets set of 3 — Charcoal144.00USDSan AntonioTX2026-08-30T11:11:21.952Z2026-09-01T11:11:21.952Z
60074ORD-2026-00996cancelledoutdoor_and_patioAdirondack chair — Terracotta1171.80USDTucsonAZ2026-08-30T02:24:21.952Znullnull
41290ORD-2026-00981deliveredbedding_and_rugsCotton waffle comforter king — Sand128.00USDDenverCO2026-08-28T17:15:24.195Z2026-08-31T17:15:24.195Z
60201ORD-2026-009713deliveredlightingLinen drum table lamp — Ivory (+1 more)234.50USDPortlandOR2026-08-28T01:44:21.952Z2026-08-29T01:44:21.952Z2026-08-31T01:44:21.952Z
60153ORD-2026-009611deliveredlightingLinen drum table lamp — Fog Grey227.70USDPhoenixAZ2026-08-26T23:19:21.952Z2026-08-27T23:19:21.952Z2026-09-02T23:19:21.952Z
60007ORD-2026-00953deliveredhome_decorSoy candle trio — Ivory (+2 more)284.35USDDenverCO2026-08-26T12:16:21.952Z2026-08-27T12:16:21.952Z2026-08-31T12:16:21.952Z
60100ORD-2026-00948deliveredkitchen_and_diningEnamel dutch oven 6qt — Sand211.00USDAtlantaGA2026-08-26T11:57:21.952Z2026-08-27T11:57:21.952Z
60295ORD-2026-009317deliveredstorage_and_organizationEntryway bench with cubbies — Charcoal150.29USDReadingPA2026-08-25T18:25:21.952Z2026-08-26T18:25:21.952Z2026-08-30T18:25:21.952Z
60178ORD-2026-009212cancelledoutdoor_and_patioOutdoor rug 6x9 — Ivory (+1 more)1281.67USDNashvilleTN2026-08-24T16:33:21.952Znull
60044ORD-2026-00915deliveredoutdoor_and_patioPatio bistro set 3-piece — Brass (+1 more)1806.00USDAshevilleNC2026-08-24T15:41:21.952Z2026-08-26T15:41:21.952Z
60255ORD-2026-009016deliveredoutdoor_and_patioString light set 48ft — Sand (+2 more)1586.46USDSan JoseCA2026-08-24T14:57:21.952Z2026-08-26T14:57:21.952Z
60140ORD-2026-008910deliveredbedding_and_rugsLinen sheet set queen — Ivory328.50USDAshevilleNC2026-08-22T02:05:21.952Z2026-08-24T02:05:21.952Z
60049ORD-2026-00885cancelledoutdoor_and_patioOutdoor rug 6x9 — Fog Grey (+1 more)1898.66USDColumbusOH2026-08-21T13:05:21.952Znull
60099ORD-2026-00878deliveredhome_decorSoy candle trio — Walnut69.84USDAtlantaGA2026-08-20T11:00:21.952Z2026-08-22T11:00:21.952Z2026-08-26T11:00:21.952Z
60086ORD-2026-00867deliveredfurnitureAlder bookshelf 5-tier — Brass (+2 more)1099.30USDMinneapolisMN2026-08-17T10:19:21.952Z2026-08-18T10:19:21.952Z
60264ORD-2026-008516deliveredlightingCeramic bedside lamp pair — Ivory155.99USDSan JoseCA2026-08-17T06:15:21.952Z2026-08-19T06:15:21.952Z
60104ORD-2026-00848deliveredkitchen_and_diningStoneware dinnerware set 12-piece — Walnut (+2 more)523.50USDAnn ArborMI2026-08-11T22:39:21.952Z2026-08-12T22:39:21.952Z
60022ORD-2026-00834deliveredbedding_and_rugsAspen 3-seat sofa — Charcoal (+1 more)745.47USDAustinTX2026-08-07T16:09:21.952Z2026-08-08T16:09:21.952Z2026-08-11T16:09:21.952Z
60043ORD-2026-00825deliveredhome_decorBrass picture frame 8x10 — Brass188.85USDColumbusOH2026-08-05T23:11:21.952Z2026-08-06T23:11:21.952Z
60073ORD-2026-00816deliveredlightingRattan pendant light — Sage285.90USDTucsonAZ2026-08-05T16:25:21.952Z2026-08-06T16:25:21.952Z2026-08-08T16:25:21.952Z
60172ORD-2026-008011cancelledbedding_and_rugsCotton waffle comforter king — Sage44.99USDPhoenixAZ2026-08-05T15:39:21.952Znull
60057ORD-2026-00796deliveredkitchen_and_diningEnamel dutch oven 6qt — Fog Grey211.00USDEugeneOR2026-08-04T18:21:21.952Z2026-08-05T18:21:21.952Z
60075ORD-2026-00786deliveredkitchen_and_diningStand mixer 5qt — Walnut187.19USDTucsonAZ2026-08-02T05:02:21.952Z2026-08-04T05:02:21.952Z
60234ORD-2026-007714deliveredkitchen_and_diningStand mixer 5qt — Brass207.99USDDearbornMI2026-08-01T07:49:21.952Z2026-08-03T07:49:21.952Z
60157ORD-2026-007611deliveredhome_decorRound wall mirror 24in — Charcoal52.99USDPhoenixAZ2026-08-01T06:06:21.952Z2026-08-02T06:06:21.952Z
60078ORD-2026-00757cancelledfurnitureKestrel accent chair — Brass888.30USDMinneapolisMN2026-07-31T23:25:21.952Znullnull
60219ORD-2026-007414cancelledlightingWoven storage baskets set of 3 — Sand (+1 more)323.00USDDearbornMI2026-07-31T18:25:21.952Znull
60061ORD-2026-00736deliveredhome_decorBrass picture frame 8x10 — Brass56.65USDReadingPA2026-07-31T12:49:21.952Z2026-08-01T12:49:21.952Z
60278ORD-2026-007216deliveredhome_decorRound wall mirror 24in — Walnut105.98USDSan JoseCA2026-07-31T09:17:21.952Z2026-08-02T09:17:21.952Z
60156ORD-2026-007111deliveredfurnitureSoy candle trio — Sand (+2 more)3108.45USDSacramentoCA2026-07-27T22:13:21.952Z2026-07-29T22:13:21.952Z2026-08-04T22:13:21.952Z
60122ORD-2026-00709cancelledstorage_and_organizationWoven storage baskets set of 3 — Terracotta (+1 more)760.50USDChicagoIL2026-07-27T03:09:21.952Znull
60266ORD-2026-006916cancelledfurnitureFairview bed frame queen — Fog Grey825.95USDSan JoseCA2026-07-27T02:11:21.952Znull
41102ORD-2026-00681deliveredhome_decorRound wall mirror 24in — Brass76.00USDDenverCO2026-07-25T17:15:24.195Z2026-07-28T17:15:24.195Z
60271ORD-2026-006716cancelledoutdoor_and_patioString light set 48ft — Ivory (+2 more)3289.02USDSan AntonioTX2026-07-25T11:08:21.952Znull
60077ORD-2026-00667deliveredstorage_and_organizationWoven storage baskets set of 3 — Sage (+2 more)776.78USDMinneapolisMN2026-07-24T18:02:21.952Z2026-07-25T18:02:21.952Z
60274ORD-2026-006516deliveredhome_decorCeramic table vase — Sage65.04USDSan JoseCA2026-07-22T12:36:21.952Z2026-07-24T12:36:21.952Z2026-07-26T12:36:21.952Z
60148ORD-2026-006410deliveredfurnitureCrystal drinkware set 6-piece — Walnut (+2 more)1387.07USDSeattleWA2026-07-22T04:08:21.952Z2026-07-24T04:08:21.952Z
60117ORD-2026-00639cancelledfurnitureEntryway bench with cubbies — Charcoal (+1 more)1777.96USDKnoxvilleTN2026-07-18T03:42:21.952Znullnull
60200ORD-2026-006213cancelledfurnitureAlder bookshelf 5-tier — Ivory (+1 more)463.36USDPortlandOR2026-07-17T22:05:21.952Znull
60115ORD-2026-00619deliveredfurnitureKestrel accent chair — Brass987.00USDChicagoIL2026-07-10T22:01:21.952Z2026-07-12T22:01:21.952Z2026-07-17T22:01:21.952Z
60106ORD-2026-00608deliveredkitchen_and_diningCast iron skillet 12in — Terracotta (+2 more)537.54USDAnn ArborMI2026-07-10T01:21:21.952Z2026-07-11T01:21:21.952Z
60183ORD-2026-005912deliveredoutdoor_and_patioAdirondack chair — Terracotta651.00USDTucsonAZ2026-07-08T18:17:21.952Z2026-07-09T18:17:21.952Z2026-07-15T18:17:21.952Z
60067ORD-2026-00586deliveredoutdoor_and_patioOutdoor rug 6x9 — Ivory1850.97USDTucsonAZ2026-07-08T02:21:21.952Z2026-07-10T02:21:21.952Z
60094ORD-2026-00577deliveredhome_decorHand-woven area rug 8x10 — Sage (+1 more)213.98USDMinneapolisMN2026-07-06T18:45:21.952Z2026-07-07T18:45:21.952Z
60208ORD-2026-005613cancelledstorage_and_organizationMatte black ceiling fixture — Sage (+1 more)268.10USDPortlandOR2026-07-05T05:12:21.952Znullnull
60002ORD-2026-00553deliveredkitchen_and_diningOutdoor rug 6x9 — Fog Grey (+1 more)815.98USDDenverCO2026-07-04T13:19:21.952Z2026-07-06T13:19:21.952Z
60184ORD-2026-005412deliveredlightingCotton waffle comforter king — Sage (+1 more)223.99USDNashvilleTN2026-07-03T04:09:21.952Z2026-07-04T04:09:21.952Z
60287ORD-2026-005317deliveredlightingBrass arc floor lamp — Walnut259.95USDEvanstonIL2026-07-01T03:22:21.952Z2026-07-02T03:22:21.952Z2026-07-07T03:22:21.952Z
60277ORD-2026-005216deliveredbedding_and_rugsWool accent rug 4x6 — Walnut (+1 more)327.94USDSan JoseCA2026-06-28T09:00:21.952Z2026-06-29T09:00:21.952Z
60136ORD-2026-005110deliveredoutdoor_and_patioOutdoor rug 6x9 — Walnut616.99USDSeattleWA2026-06-26T02:05:21.952Z2026-06-28T02:05:21.952Z
60120ORD-2026-00509deliveredbedding_and_rugsMatte black ceiling fixture — Fog Grey (+2 more)555.98USDChicagoIL2026-06-25T17:42:21.952Z2026-06-26T17:42:21.952Z2026-07-02T17:42:21.952Z
60103ORD-2026-00498deliveredlightingRattan pendant light — Walnut (+1 more)207.45USDAtlantaGA2026-06-25T02:16:21.952Z2026-06-26T02:16:21.952Z2026-07-02T02:16:21.952Z
60298ORD-2026-004817deliveredstorage_and_organizationRowan dining table 6-seat — Fog Grey (+2 more)1327.06USDEvanstonIL2026-06-22T06:28:21.952Z2026-06-23T06:28:21.952Z
60150ORD-2026-004710cancelledkitchen_and_diningStoneware dinnerware set 12-piece — Charcoal (+1 more)1150.95USDSeattleWA2026-06-21T16:52:21.952Znull
60050ORD-2026-00465cancelledoutdoor_and_patioOutdoor rug 6x9 — Walnut (+1 more)1977.47USDColumbusOH2026-06-20T11:13:21.952Znull
60220ORD-2026-004514deliveredfurnitureAspen 3-seat sofa — Sand274.50USDAnn ArborMI2026-06-20T05:51:21.952Z2026-06-21T05:51:21.952Z2026-06-26T05:51:21.952Z
60135ORD-2026-004410deliveredstorage_and_organizationCloset organiser system — Sand341.90USDSeattleWA2026-06-06T04:41:21.952Z2026-06-08T04:41:21.952Z2026-06-11T04:41:21.952Z
Open the CSV file ↗
Expected vs. Found
✓Expected: Returns the subset of t1’s answer, with t1’s other conditions still applied.Found: It returned three Texas orders from the same 90-day window; all three are in the first turn’s 59-row result.
Supporting proof
Proof 2Screenshot
Turn 1 query, SQL window, 59-order answer, and a 10-row preview.
Open original ↗
Proof 3Screenshot
Turn 2 query, SQL with the Texas filter, 3-order answer, and a three-row table.
Open original ↗
Why this result

It kept the full 90-day window from the first turn and added Texas. The three returned orders all appear in the first turn’s 59-row result, and no Texas row was left out.

Also observed on this row

Window ended at midnight. The first answer’s window ended at midnight on September 2, so an order placed later that day was outside it; the 59-row export does not include ORD-2026-0103.

Texas filter. Texas was matched by the state code TX, and the answer kept the September 2 date.

Unquoted commas. The exported CSV leaves commas inside item summaries unquoted, so some rows need special parsing.

Tested by Ayush Ghosh · evidence dated 6 October 2026

Configuration and setup

How this tool was set up for the run and what the test needed in place. Each row is a fact from the run's records; a fact the records do not hold is left out, not guessed.

Software that produced the output
AskYourDatabase
Build or version
Not exposed by the hosted product
Surface
Web app
Set up before the run
The first answer needed at least one matching order and at least one non-matching order in the region so narrowing could produce a subset.
Tested
6 October 2026 · Ayush Ghosh
Connected to
databaseCedarline commerce database (customer_support_db) · version 1

How this scenario is graded

How we decide Pass, Fail and Not gradable. The same rules apply to every tool tested on this scenario.

How results are decided

Each test case gets one result per tool: Pass, Fail or Not gradable. A test case we haven't run yet shows Untested. There are no partial results.

The rules
  • Pass: the tool did everything the test expected, and nothing it said contradicts the correct answer.
  • Fail: at least one expected behaviour clearly didn't happen; the row says which and quotes the tool.
  • Not gradable: our evidence couldn't settle the outcome (for example a record we needed is missing). It is never counted as a fail, and the row says what's missing.

Where this sits in the benchmark

This page is one cell of a larger study: one tool, one scenario. Only this benchmark's frame appears here.

LevelNameScope
BenchmarkAI Database Agents →28 scenarios · 4 tools
CapabilityConversational Interaction →
ScenarioThe user narrows what they just asked →
ToolAskYourDatabase →

Global scenario definition → · Global capability definition → · AskYourDatabase product page →

History of this result

What has happened to this result since it was first published. Runs and grades are never overwritten: a retest or a re-grade publishes a new result and keeps the earlier one readable.

from the publication record
7 October 2026First publishedAI Database Agents v1

Act on this result

Nothing filed here edits the run or the grade. A challenge opens a review, and a review can produce a new run or a re-grade — which becomes the current result and leaves this one in the history.

This matches what I see

You run the same kind of test against your own setup and get the same behaviour.

Agree →
This does not match

Yours behaves differently. Tell us what you got, with a screenshot if you have one.

Disagree →
Point out an issue

Something here is wrong — a reference value, a transcription, a grade.

Report an issue →
Request a retest

On a newer build, a larger dataset, or your own setup.

Request a retest →
We have fixed this

Tell us what changed and we schedule a rerun of the failing test case. The old result stays as history.

Vendor notice →
Filed against this evidenceNothing yet. Challenges, counter-evidence and fix notices appear here with their outcome, and stay on the page after they are resolved.
Cite this result
aidemos.com/benchmarks/ai-database-agents/results/askyourdatabase/the-user-narrows-what-they-just-asked · 1 pass · 0 fail · coverage 1/1 · graded 2026-10-07

The same record is available as structured data through the AI Demos MCP server, with the counts, the coverage and every per-test-case reason carried as fields.

Verify the proof files

These files support this result. Open a file to inspect the original evidence.

Proof 2 · Screenshot ↗image/png · 82 KB
Proof 3 · Screenshot ↗image/png · 58 KB
Proof 1 · Output file (CSV) ↗text/csv; charset=utf-8 · 10 KB
File fingerprints (SHA-256)

A fingerprint identifies the exact file used for this result.

Proof 2 · Screenshot0ee08be0a6448da787cb4b3c6e1dd151b0ad9300b84097d80e42fb3b72234675
Proof 3 · Screenshot9f1dcf56af8bb124d578ac41946ec26f4f016a2ab12599f6bd81e8008841b8dd
Proof 1 · Output file (CSV)59de2dd6b73d212115b162075a99d94e09678c1d38e65c00d4c0eae3548613a0
Every verdict on these pages is openable to the execution behind it. Where an execution was reconstructed rather than captured, the page says so — a finding and a measurement are not the same claim.