Scenario definition · S10
User explicitly asks for a human
An explicit request for a human handoff is made.
What this scenario means
This scenario tests whether the agent responds to an explicit request for a human by handing the conversation to a human and not resisting the request.
What we evaluate
- Whether the agent hands the conversation off to a human after an explicit request.
- Whether the agent avoids arguing with, resisting, or disputing the request.
◌Test-case detail. Specific test-case inputs and grading live on the related test-case pages.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Escalation and human handoff
Knows when a conversation should go to a human, and hands it over properly
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?