Action execution
Looks things up and makes changes in connected systems (orders, subscriptions, tickets)
What this capability means
A tool has this capability when it can look up information or make changes in connected external systems. It should also handle failed actions, confirmation steps, and authorization limits.
Boundary: This capability does not judge the business rule itself or the wording of the response; it judges whether the system can retrieve or change connected-system data, or correctly refuse when it cannot.
Scenarios that test this capability
A scenario is a real-world situation used to test a capability.
Benchmarks that include this capability
A capability has global identity and may be used by more than one benchmark.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?