It follows the billing workflow for a suspected double charge by asking whether the entries are pending or posted, requesting transaction references, and reserving escalation for a genuine duplicate posted charge.
What was measured
Policy Accuracy
Gives policy details that match the provided knowledge base and does not misstate rules.
decisive for this rankingtransformation
Giving the wrong policy details is a direct failure for a customer-support chatbot. (3 of 3 judges)
What was given, what came back
Test input: Customer-support handoff request · text
Input — what we sent
The exact prompt
I received the wrong item in my order. I've already checked the order details and this is clearly a mistake on your end. I don't want any more back and forth — can you please connect me to a customer support agent or raise a ticket for this?
A frustrated support-escalation request after receiving the wrong item, asking to be connected to a support agent or have a ticket raised.
Why this input is hard
- · Human handoff reliability
- · Ticket creation workflow
- · Escalation contextual awareness
- · Professional tone under frustration
Output — unretouched
Also checked on this input — same tool, 4 other criteria
Multilingual Understanding✓ WorkedIt understands the Hindi support request and answers fully in Hindi, preserving the support-channel options and response-time details.Multilingual Understanding✓ WorkedIt understands the Spanish support request and replies fully in Spanish with the same multi-channel escalation options and timing information.Response Completeness✓ WorkedIt fulfills a direct request for human help by listing multiple escalation channels — email, phone, and live chat — with response-time guidance instead of forcing self-service.Response Completeness✓ WorkedIt correctly recognizes a bot-avoidance request as escalation intent and provides the full human-support channel list, including email, phone, and ticket portal.
Provenance
- Observation
- e51bc81e-5912-4efa-946a-8c4c52436184
- Evidence run
- 2645dc92-49df-478a-b809-21dfd09f06a7
- Study
- Automate customer support using an AI chatbot
- Research task
- 86b9jm3ev
- Tested at
- not recorded
- Source
- first-party
- Evidence state
- verified
- Proof shown
- input + output shown
- Cost / latency
- not captured
- Repeat run
- not captured
- Tester
- not captured
The last three rows are honest blanks, not placeholders — our capture has no field for them yet.
Query this
get_evidence({
tool: "wonderchat"
})MCP · mcp.aidemos.com/api/mcp
Free with attribution.
Same input, same check — 0 other tools
measured on Policy Accuracy
No other tool was measured on this criterion for this input.
This evidence is published in
Real inputs and real outputs, no retouching · every cell queryable via API & MCP · aidemos.com