Goal-Driven Data Story, Narrations and Explanations
Aniya Aggarwal, Ankush Gupta, et al.
NAACL 2025
Large Language Models (LLM) have become a popular approach for implementing Retrieval-Augmented Generation (RAG) systems, and a significant amount of effort has been spent on building good models and metrics. In spite of increased recognition of the need for rigorous evaluation of RAG systems, few tools exist that go beyond the creation of model output and automatic calculation. We present InspectorRAGet, an introspection platform for RAG evaluation. InspectorRAGet allows the user to analyze aggregate and instance-level performance of RAG systems, using both human and algorithmic metrics as well as annotator quality. InspectorRAGet is suitable for multiple use cases and will be made available publicly to the community.
Aniya Aggarwal, Ankush Gupta, et al.
NAACL 2025
Stephanie Houde, Krissy Brimijoin, et al.
IUI 2025
Chulaka Gunasekara, Guy Feigenblat, et al.
ACL-IJCNLP 2021
Kushagra Bhushan, Yatin Nandwani, et al.
NAACL 2025