Tool in benchmark · Version 1

Chatbase in AI Customer Support Chatbots

Scenario-level performance from current published Results.

No published Results are available for Chatbase in this benchmark. · 26 scenarios in the benchmark

Publication availability does not describe testing status.

How Chatbase performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.

Action execution5 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Action requires confirmation	No published result
Requested action cannot be completed	No published result
Retrieve information from an external system	No published result
Update something in an external system	No published result
User is not authorized to perform the action	No published result

Agent configuration and control2 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Configured instruction changes agent behavior	No published result
Configured restriction is respected	No published result

Analytics and observability3 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Agent actions/tool calls can be inspected	No published result
Conversation activity can be inspected	No published result
Reported analytics match what actually happened	No published result

Conversation continuity3 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Customer corrects information given earlier	No published result
Earlier conversation/session needs to be continued	No published result
Information from earlier in the conversation is needed later	No published result

Escalation and human handoff3 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
A configured rule requires escalation	No published result
Agent cannot resolve the request	No published result
User explicitly asks for a human	No published result

Feedback and learning2 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Correction changes future behavior where the product claims learning	No published result
Feedback can be submitted	No published result

Intent understanding3 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
One message contains multiple requests	No published result
Request is unclear and needs clarification	No published result
Request requires choosing the correct source or action	No published result

Knowledge-grounded answering3 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Answer is available in the knowledge base	No published result
Answer is not available in the knowledge base	No published result
The request uses different wording than the source	No published result

Multilingual support2 scenarios · 0 with published Results

Scenario	Published outcomes	Test coverage	Result
Customer communicates in another supported language	No published result
Customer switches languages during the conversation	No published result

Published evidence and test coverage answer different questions.

Publication availability

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

The 26 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for Chatbase.