A new independent testbed evaluates long-term memory (LTM) frameworks for LLM-based agents in distributed cloud-edge environments. The study compares mem0, Graphiti, cognee, RAG, and full-context baselines on the LoCoMo benchmark, finding that mem0, RAG, and full-context achieve 77–81% accuracy, while Graphiti and cognee reach only 55–56%. RAG matches the top accuracy at 8.4 times lower total cost of ownership than mem0, and both are the only non-dominated backends on the Pareto frontier.
Why it matters: This work provides the first independent, reproducible comparison of LTM frameworks for multi-agent systems, showing that retrieval completeness, not context volume, drives accuracy and that RAG offers the best cost-performance trade-off.
Researchers present NAILS, a method that aligns recommender system outputs with target distributions over item attributes such as fairness and diversity, without requiring retraining. NAILS adjusts the user-conditional item distribution to achieve specified marginal attribute distributions while preserving the system's learned user preferences. Experiments demonstrate that NAILS improves attribute-level alignment with minimal effect on user engagement.
Why it matters: This approach offers a scalable way to embed normative values like fairness and diversity into existing recommender systems without retraining or significant performance loss.
Researchers introduce PaperRouter-Agent, a training-free large language model (LLM) agent designed to route new academic papers into user-specific folder hierarchies by grounding its decisions in the content of folder members rather than relying solely on folder names. In tests on real personal libraries, PaperRouter-Agent improved Recall@1 from 0.39 to 0.61 and Recall@3 from 0.57 to 0.83. On the public LaMP-2 benchmark, it increased accuracy from 44.5% to 51.5% and macro-F1 by 9.0 points over a single-shot baseline.
Why it matters: This work demonstrates a significant advance in personalized information organization, showing that LLM agents can effectively route papers in reference managers without per-user training.
Researchers introduce TALRanker, a framework that models relevance scoring as a Markov decision process, enabling large language models to selectively use external tools only when uncertain. The approach employs a two-stage training process—first preventing catastrophic forgetting, then using reinforcement learning to optimize tool invocation. TALRanker achieves state-of-the-art results on retrieval benchmarks while maintaining throughput comparable to pointwise rerankers.
Why it matters: This work offers a novel solution to the accuracy-efficiency trade-off in LLM-based reranking by enabling models to autonomously decide when to use external tools, reducing latency without compromising performance.
Meta introduces RankGraph-2, a framework that co-designs graph construction, representation learning, and real-time serving for similarity-based retrieval at billion-node scale. The system reduces serving computational cost by 83% and achieves up to +0.96% click-through rate (CTR) and +2.75% conversion rate (CVR) improvements. RankGraph-2 has been deployed to power over 20 retrieval launches across major Meta surfaces.
Why it matters: RankGraph-2 demonstrates a significant advance in large-scale recommendation systems by jointly optimizing all stages of graph-based retrieval, resulting in notable efficiency and performance gains.
Researchers have introduced Adaptive Model Compression (AMC), a framework that dynamically allocates hardware resources during transformer inference based on token saliency. AMC uses a multi-tier architecture to process important tokens at full precision while compressing less significant data, resulting in a 59.2% reduction in system energy and a 2.24x increase in throughput on 45nm CMOS hardware, with only a 3.6% drop in accuracy.
Why it matters: This approach could make it feasible to run large transformer models efficiently on edge devices, significantly improving battery life without major performance loss.
Researchers present CORE-Bench, a new benchmark designed to evaluate code retrieval in agentic coding scenarios. The benchmark assesses models on code understanding, issue-to-edit localization, and broader context retrieval, using over 180,000 queries and 106,000 relevance labels. Results show that current embedding models perform poorly on these tasks, but simple supervised fine-tuning leads to notable improvements, highlighting significant room for advancement.
Why it matters: CORE-Bench fills a critical gap in evaluating code retrieval for AI coding agents, supporting the development of more capable systems for navigating and understanding code repositories.
Researchers introduce GRASP, a reinforcement learning framework that enables agents to adaptively coordinate semantic search, keyword search, and paragraph reading during multi-step reasoning. The policy learns to control context granularity, leading to improved retrieval recall and question answering performance on multi-hop benchmarks. The learned strategies include interpretable skimming and scanning behaviors.
Why it matters: This work advances agentic retrieval-augmented generation by enabling dynamic and context-aware retrieval strategies, which are important for accurate multi-step reasoning.
Researchers have introduced ARGUS-EVAL, a new evaluation framework that assesses Vision-Language Models (VLMs) not only on their benchmark capabilities but also on cross-dataset consistency, robustness, and efficiency. Testing models such as Qwen-2.5VL-3B-Instruct and CLIP, the study finds that models with similar benchmark scores can differ significantly in reliability and efficiency. Qwen-2.5VL-3B-Instruct demonstrates the highest overall capability, while CLIP stands out for its efficiency.
Why it matters: ARGUS-EVAL provides a more comprehensive way to evaluate and select VLMs for real-world applications by highlighting differences in reliability and efficiency that are not captured by standard benchmarks.
SVD-RAG introduces the use of Singular Value Decomposition (SVD) on dense sentence embeddings for extractive summarization in hierarchical Retrieval-Augmented Generation (RAG) systems, replacing the need for expensive LLM-based summarization. The method achieves retrieval quality within 1-5% of RAPTOR while constructing the retrieval tree 317 times faster and reducing token consumption by approximately 85%. SVD-RAG is deterministic, cost-efficient, and adapts to content complexity automatically.
Why it matters: This approach makes hierarchical RAG systems significantly more practical and scalable by reducing computational cost and latency without substantially sacrificing retrieval quality.
A new preprint introduces PTFEA, a curriculum-learning-inspired framework that mathematically unifies context engineering and fine-tuning for Multimodal Entity Alignment (MMEA). PTFEA adapts information injection stages based on confidence thresholds and uses progressive inference to mirror fine-tuning processes. Experiments on five public datasets show PTFEA consistently outperforms strong baselines, achieving over 80% reduction in runtime and token consumption compared to prior context-engineering methods, while narrowing the performance gap between large and small models.
Why it matters: PTFEA offers a theoretically grounded and highly efficient alternative to traditional fine-tuning for MMEA, potentially lowering computational costs and broadening access to high-performance multimodal alignment.
FAIR GraphRAG is a novel framework that incorporates FAIR Digital Objects as nodes in a graph-based retrieval system to enhance retrieval-augmented generation for domain-specific question answering. Co-designed by physicians and computer scientists, the system leverages large language models for schema construction and metadata extraction, and demonstrates improved accuracy, coverage, and explainability on complex biomedical queries involving metadata and ontology links. The approach is validated on a gastroenterology RNA-sequencing dataset and is positioned as applicable to other specialized domains.
Why it matters: This work represents a meaningful advance by combining FAIR data principles with graph-based retrieval and LLMs, improving semantic data analysis and question answering in complex, specialized fields.
Researchers introduce Prompt Generation (PG), a configuration-driven framework that decouples feature-processing logic from model architecture using declarative JSON files. This approach standardizes feature processing, enabling faster training iteration, streamlined deployment, and efficient online inference. Deployed on Taobao Search, PG achieved statistically significant uplifts of +0.47% in transaction count and +0.51% in gross merchandise value (GMV) during online A/B tests.
Why it matters: PG demonstrates a practical advance in industrial AI systems by reducing engineering complexity and accelerating deployment for large-scale search and recommendation platforms.
A new preprint introduces MC-RAG, a structure-driven retrieval-augmented generation (RAG) system that reformulates retrieval as a subgraph matching problem over a knowledge graph. By combining semantic and structural embeddings with path-level indexing, MC-RAG aims to improve the handling of complex, multi-constraint queries, offering more interpretable and constraint-consistent retrieval and generation. The system is demonstrated with interactive examples and a demo video.
Why it matters: MC-RAG proposes a novel approach to address the challenge of constraint violations and hallucinations in RAG systems when handling complex queries, potentially improving reliability and interpretability.
A new preprint demonstrates that cross-lingual prompt injection attacks can significantly inflate relevance scores in LLM-based information retrieval systems, while evading current prompt-injection defenses. The attacks, tested across eight languages and multiple open-weight models, can also adapt to bypass modified defense mechanisms. This exposes a critical vulnerability in using LLMs as automated relevance judges.
Why it matters: The study reveals that language diversity can be exploited as an attack vector, exposing a major security gap in LLM-based evaluation systems.
Products & Agents→Official→arXiv Information Retrieval
Apple Music has deployed a multilingual semantic retrieval system based on a 305M-parameter bi-encoder fine-tuned from GTE-multilingual-base. In a global A/B test, the system achieved a 2.28% relative conversion-rate lift and an 86% reduction in no-result rate, with tail queries seeing a 7.93% lift. The system uses a hybrid retrieval approach, blending dense nearest-neighbor results with the existing token-based index.
Why it matters: This deployment demonstrates a significant search quality improvement at scale for a major music streaming platform, particularly benefiting hard-to-match tail queries without regressing popular ones.
Researchers from Vrbo introduce a training-free candidate generation pipeline that leverages off-the-shelf large language models (LLMs) to address the long-tail problem in vacation rental marketplaces. By generating semantic queries from property metadata and retrieving candidates via approximate nearest-neighbor search, the system significantly extends candidate coverage to tens of thousands of properties previously unreachable by behavioral methods. A Union fusion strategy merges LLM-generated candidates with existing behavioral approaches, maintaining or improving performance for well-served properties while delivering the largest gains for niche and new listings.
Why it matters: This work offers a scalable, practical solution for improving recommendation coverage for underrepresented listings in large marketplaces, using LLMs without additional training or reliance on expensive APIs.
A new framework, NGM-RAG, integrates graph construction, graph matching, and answer generation to enhance retrieval-augmented generation (RAG) for large language models. By combining text-based and graph-based retrieval using neural graph matching and adaptive weighting, NGM-RAG better captures relational knowledge. Experiments show that NGM-RAG outperforms NaiveRAG, GraphRAG, and LightRAG on multi-hop question answering and long-context summarization tasks.
Why it matters: This approach addresses a key limitation of traditional RAG by enabling more effective multi-hop reasoning, potentially improving LLM performance on complex information-seeking tasks.
Researchers propose a distillation method that trains a compact dense retriever using only teacher score vectors, without requiring access to teacher hidden states. Their 0.6B parameter student model recovers up to 50% of the base-to-teacher performance gap on a standard evaluation panel, while achieving 4.7× faster query encoding and 9.7× faster document encoding compared to sequential teacher fusion. However, external-transfer performance after distillation is mixed.
Why it matters: This approach offers a practical path to compress large retrieval models for more efficient online serving, though its effectiveness may vary across tasks.
Researchers at Walmart present a unified pipeline for embedding-based retrieval that addresses both training-inference gaps and challenges in model evolution. Their approach combines hybrid hard negative mining and legacy-aware distillation, enabling a smooth transition to higher-capacity models. The system, deployed in live production, achieved a +7.34% improvement in NDCG@5 and a +0.50% increase in gross revenue.
Why it matters: This work demonstrates practical advances for improving the effectiveness and stability of large-scale embedding-based retrieval systems in real-world e-commerce settings.