M-RAG: Semantic Key-Value Indexing for Retrieval-Augmented Generation
M-RAG proposes a semantic key-value indexing layer for retrieval-augmented generation (RAG) systems, decoupling retrieval keys from generation payloads. This approach allows for more efficient use of context budgets and improved retrieval robustness. Experiments on LongBench QA tasks demonstrate that M-RAG achieves competitive or better accuracy than chunk-based baselines, with higher document coverage and lower retrieval latency.
Why it matters: This work introduces a practical and effective indexing method that addresses inefficiencies in current RAG pipelines, potentially improving the accuracy and efficiency of large language model applications.
Full story at: arXiv Information Retrieval ↗