Scenario definition · S6
Request is unclear and needs clarification
A request is unclear, so the agent must ask for clarification before it answers or acts.
What this scenario means
This scenario tests whether the agent can recognise an ambiguous request and stop to clarify the intended meaning before taking any next step. The correct behaviour is to ask a clarifying question rather than guess an answer or carry out an action.
What we evaluate
- Whether the agent recognises that the request is unclear.
- Whether the agent asks for clarification before answering or acting.
- Whether the agent avoids proceeding on the basis of the ambiguity alone.
◌Test-case detail. Specific test-case inputs and grading live on the related test-case pages.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Intent understanding
Works out what the customer actually wants before answering or acting
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?