Scenario definition · S7
Information from earlier in the conversation is needed later
A later turn or session requires information established earlier in the conversation.
What this scenario means
This scenario checks whether the assistant retains earlier conversational context when a later turn depends on it. Correct behaviour is to use the information already established, continue the conversation from that context, and not re-ask for details that were already given or behave as if they were forgotten.
What we evaluate
- Whether the assistant uses information established earlier when answering a later turn.
- Whether the assistant continues the conversation from prior context without re-asking for already provided details.
- Whether the assistant preserves relevant context across turns or sessions when the later request depends on it.
◌Test-case detail. Specific test-case inputs and grading live on the related test-case pages.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Conversation continuity
Keeps track of what has already been said — across turns and across sessions
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?