Scenario definition · S9
Earlier conversation/session needs to be continued
A follow-up depends on resuming an earlier conversation or session from prior context.
What this scenario means
This scenario tests whether the assistant can carry forward an earlier conversation or session and continue the same thread from prior context. The correct behaviour is to use what was already established, keep the exchange connected, and handle the follow-up without making the earlier context start over.
What we evaluate
- Whether the assistant uses earlier context to continue the same issue.
- Whether the assistant treats the follow-up as a continuation rather than a fresh request that must be fully re-explained.
- Whether the assistant carries the thread forward across turns or across sessions when the earlier context is available.
◌Test-case detail. Specific test-case inputs and grading live on the related test-case pages.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Conversation continuity
Keeps track of what has already been said — across turns and across sessions
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?