Answer is available in the knowledge base
The relevant source already contains the answer, and the system surfaces it correctly.
What this scenario means
This scenario checks whether the system can surface an answer when the relevant source already contains it. Correct behaviour is to retrieve or state the source-grounded answer, not invent a new one or leave the answer undiscovered.
What we evaluate
- Whether the system surfaces the answer when the relevant source already contains it.
- Whether the output is grounded in the source content rather than invented.
- Whether the system handles a present answer as a successful source-based result.
Capabilities this scenario exercises
A scenario may exercise one or more capabilities.
Knowledge-grounded answering
Answers customer questions from the company's own knowledge base — not from what the model assumes
Retrieval
The passage that answers the question comes back when the documents hold it — and the absence is discoverable when they don't. Judged against the documents: did the supporting passage come back?
Benchmarks that use this scenario
A scenario has global identity and may be reused across benchmarks.
Managed RAG
Also uses this scenario.
AI Customer Support Chatbots
Automate customer support using an AI chatbot / AI customer support agent — which agents handle real customer support conversations for a business best?