Tool in benchmark · Version 1

Llama Cloud in Managed RAG

Scenario-level performance from current published Results.

No published Results are available for Llama Cloud in this benchmark. · 15 scenarios in the benchmark

Publication availability does not describe testing status.

How Llama Cloud performed

Open a capability to explore its scenarios. Each row reports the test set in its published Result; counts are not combined into an overall score.

Citations1 scenario · 0 with published Results
ScenarioPublished outcomesTest coverageResult
A claim in the answer traced back to its sourceNo published result
Data Ingestion4 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
A bad file in the uploadNo published result
A cleanly scanned documentNo published result
A simple, clearly formatted tableNo published result
An ordinary digital text documentNo published result
Grounded Generation3 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
The retrieved material doesn't support an answerNo published result
The retrieved material supports an answerNo published result
The retrieved sources disagree with each otherNo published result
Knowledge Sync3 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
Content is removed from the sourceNo published result
Existing content is changedNo published result
New content is added to the sourceNo published result
Retrieval4 scenarios · 0 with published Results
ScenarioPublished outcomesTest coverageResult
Answer is available in the knowledge baseNo published result
Answer is not available in the knowledge baseNo published result
Retrieval is scoped to part of the documentsNo published result
The request uses different wording than the sourceNo published result

Reading these Results

Published evidence and test coverage answer different questions.

Publication availability

Which scenarios have a Result?

A published Result is public evidence for this tool on one scenario. “No published result” does not say whether testing has taken place.

Test coverage

What does each Result cover?

Assessed includes Pass, Fail and Not gradable. Gradable includes Pass and Fail. Both use the pinned test count in that published Result.

Scenario scope

Inventory is not testing progress

The 15 scenarios describe this benchmark’s scope. They are not an assumed applicability or test-coverage denominator for Llama Cloud.

Llama Cloud in Managed RAG | AI Demos