ResearchQA: Benchmarking Citation-Grounded Question-Answering on Scientific Papers

Jul 14, 2026

ResearchQA is a new benchmark comprising 6,211 question-answer pairs from 494 open-access scientific papers across eight domains, designed to evaluate citation-grounded question answering. It covers four question types and rewards grounded refusal when answers are unsupported by the source. Evaluation of eight leading models shows that citation-based metrics distinguish system performance more clearly than LLM evaluator scores, and open-weight models approach the citation accuracy of top closed models while operating at lower latency.

Why it matters: This benchmark enables more rigorous assessment of whether language models can answer scientific questions with verifiable citations, addressing a key limitation in current evaluation methods.

Full story at: arXiv Computation and Language ↗