Scenario definition · S5
One message contains multiple requests
A customer message contains multiple requests in one interaction.
What this scenario means
This scenario tests whether a single customer message carries more than one request and whether the agent recognises each request and handles each appropriately. Correct behaviour is to separate the requests and respond to each one according to its own intent.
What we evaluate
- Whether the message contains more than one distinct request.
- Whether the response addresses each request separately and appropriately.
- Whether no request is ignored, merged, or left unanswered when another request is also present.
◌Test-case detail. Specific test-case inputs and grading live on the related test-case pages.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Intent understanding
Works out what the customer actually wants before answering or acting
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?