← Back to brief

Source archive

arXiv Information Retrieval

arXiv's cs.IR (Information Retrieval) category covers research on search and retrieval, including retrieval-augmented generation (RAG) and other methods for finding and ranking relevant information with AI.

37 AISurfing briefingsVisit official source ↗

Briefings where arXiv Information Retrieval is the primary source

ResearchOfficialarXiv Information Retrieval

DIVE: Embedding Compression via Self-Limiting Gradient Updates

A new method called DIVE is introduced for compressing language-model embeddings using a residual compression adapter that incorporates a self-limiting hinge loss and geometry distillation. In experiments on five BEIR benchmarks with LLM2Vec backbones, DIVE consistently outperforms six baseline methods, including PCA and autoencoders, at both 128- and 256-dimensional outputs.

Why it matters: DIVE enables more efficient storage and retrieval in large-scale information retrieval systems by compressing embeddings without sacrificing retrieval quality.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

CtrlBench-Rec: A Framework for Evaluating Controllability in Recommender Systems

Researchers introduce CtrlBench-Rec, a collaborative multi-agent framework designed to systematically assess the controllability of recommender systems, which are often treated as black boxes. The framework formalizes three key tasks—target content discovery, interest profile shaping, and popularity bias mitigation—to measure how well recommender systems can be steered by explicit or implicit user guidance. Experiments across real-world datasets and models show that CtrlBench-Rec quantifies controllability and highlights persistent challenges, such as resistance to promoting long-tail content.

Why it matters: CtrlBench-Rec provides the first standardized toolkit for evaluating and auditing the controllability of recommender systems, addressing a critical gap in algorithmic transparency and user empowerment.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

Critical Survey Finds Limited Evidence for Generative Engine Optimization Impact on Discoverability

A new survey of 45 studies on Generative Engine Optimization (GEO) finds that while interventions can affect how already-retrieved content is cited or used by generative engines, no technique demonstrates a stable, long-term, cross-platform causal effect on organic discoverability. The paper introduces a multistage formal model and a reproducible protocol for evaluating GEO methods, highlighting the complexity and variability of the field. The review also notes that commonly cited gains are often conditional and do not generalize to broader visibility or traffic outcomes.

Why it matters: This survey clarifies the limited empirical support for GEO strategies, helping practitioners and researchers focus on interventions with proven effects and avoid overestimating their impact on generative engine visibility.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

With Argus Eyes: Assessing Retrieval Gaps via Uncertainty Scoring to Detect and Remedy Retrieval Blind Spots

Researchers identify 'blind spots' in neural retrievers used in retrieval-augmented generation (RAG) systems, where relevant entities are not retrieved due to low embedding similarity. They introduce a Retrieval Probability Score (RPS) to predict these blind spots before indexing, and present ARGUS, a pipeline that augments documents from a knowledge base to improve retrievability. Experiments across multiple retrievers and datasets show consistent improvements in retrieval metrics, with average gains of +3.4 nDCG@5 and +4.5 nDCG@10.

Why it matters: This work tackles a key reliability challenge in RAG systems by enabling the detection and mitigation of retrieval blind spots, which is important for building more robust and trustworthy AI applications.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

LLM-Based User Personas for Real-Time Recommendations at Scale

A new framework enables real-time generation of natural-language user interest personas using large language models (LLMs) for a large-scale commercial video recommendation platform. The system addresses the exploitation-exploration trade-off by summarizing user interests and introducing novel topics during serving. To support deployment at billion-user scale, the architecture incorporates knowledge distillation, asynchronous inference, and input optimization. Offline evaluations, user studies, and live A/B tests show significant improvements in viewer value.

Why it matters: This work demonstrates a practical approach for deploying LLMs in real-time personalization at industrial scale, advancing the integration of semantic understanding in recommendation systems.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

Cluster with Auctions: Jointly Optimizing Database Partitioning and Query Probing for Vector Search

Researchers present CwA (Cluster with Auctions), a method that jointly learns balanced database partitions and a neural probing function for approximate nearest neighbor search. Unlike traditional approaches that use the same assignment function for both queries and database vectors, CwA decouples these processes and directly optimizes search performance for the query distribution. The method employs a parallelizable auction algorithm for combinatorial optimization and demonstrates up to 4.7× throughput improvement over state-of-the-art methods when query and database distributions differ.

Why it matters: This work offers a significant advance in vector search efficiency, particularly in scenarios where query and database distributions are not aligned, by optimizing both partitioning and probing functions jointly.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

Study Decomposes Noise in LLM Brand Measurements, Finds Query Language Dominates Variance

A new preprint decomposes the sources of non-determinism in large language model (LLM) brand measurements, revealing that query language accounts for 26.5% of the variance in brand sentiment responses, while brand identity itself contributes only 1.5%. The authors recommend that, to improve measurement reliability, practitioners should allocate resources to sampling across different languages and models rather than simply repeating prompts.

Why it matters: This work provides a rigorous framework for understanding and mitigating reproducibility issues in LLM-based brand measurement, offering actionable guidance for more reliable evaluation.

Jul 16, 2026

ResearchOfficialarXiv Information Retrieval

Embedding Compression via PCA Improves Domain Adaptation in Dense Retrieval

A new study demonstrates that applying Principal Component Analysis (PCA) to compress query embeddings can enhance retrieval performance in specialized domains. The approach was tested across 9 dense retrievers and 14 MTEB datasets, showing improved NDCG@10 scores in 75.4% of model-dataset pairs compared to standard embeddings. This method preserves domain-relevant features while removing non-discriminative components, providing a lightweight, training-free alternative to traditional domain adaptation methods.

Why it matters: This technique offers a simple and efficient way to improve dense retrieval in specialized domains without the need for costly annotation or retraining.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

iTIMO: LLM-Empowered Dataset for Travel Itinerary Modification

Researchers have introduced iTIMO, a dataset designed to address the underexplored task of travel itinerary modification. The dataset is generated by instructing large language models to perturb real-world itineraries using REPLACE, ADD, and DELETE operations, guided by intents such as popularity disruptions, spatial distance, and category diversity. The work also benchmarks state-of-the-art LLMs on this task, revealing their strengths and limitations.

Why it matters: iTIMO provides a comprehensive testbed for developing and evaluating adaptive travel recommendation systems that can handle dynamic and changing user needs.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

SkillSelect-Serve: QoS-Aware Budgeted Skill Service Recommendation for LLM Agents

Researchers introduce SkillSelect-Serve, a framework that recommends reusable agent skills for LLM agents while respecting constraints such as token budget, risk, and tool availability. By profiling skills as structured services and applying a constrained projection method, the system achieves 100% deliverability with minimal loss in hit rate. The approach outperforms traditional Top-k retrieval methods, significantly reducing risk exposure and tool violations.

Why it matters: This work offers a practical advance for deploying LLM agents by enabling reliable, constraint-aware skill selection, which is crucial for efficient operation under real-world resource limits.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

Vision-Free Composed Image Retrieval Sets New Zero-Shot Benchmark with Attribute-Augmented Scoring and LLM Reranking

A new framework for Composed Image Retrieval (CIR) achieves state-of-the-art zero-shot performance on the CIRR dataset (44.04% R@1, an improvement of 8.79%) without using visual features. The approach combines attribute-augmented hybrid scoring to address the loss of visual detail and LLM-based reranking to ensure semantic consistency. Ablation studies confirm that both components contribute to the performance gains.

Why it matters: This work shows that vision-free methods can outperform traditional approaches on complex multimodal retrieval tasks, suggesting new directions for efficient and simplified retrieval systems.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

SlimPer: A Slim and Smart Personalization Model for Recommendation Systems

SlimPer introduces a new approach to personalized ranking in recommendation systems by iteratively refining a compact knowledge base, rather than relying on large intermediate representations that scale with user history length. This design achieves O(N) per-layer computational cost and fixed-size intermediate representations, allowing the model to handle over 10,000 user history events efficiently. Deployed on Instagram Reels and Feed, SlimPer has demonstrated measurable improvements in user engagement while unifying sparse, dense, and sequence features within a single model backbone.

Why it matters: SlimPer enables deeper and more efficient personalization in large-scale recommendation systems by decoupling model depth from user history length, reducing compute and memory requirements.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

MESH: Scaling Up Retrieval with Heterogeneous Content Unification

MESH is a unified retrieval scaling framework designed to address the scaling bias of heterogeneity in large-scale recommendation systems. Through a modularized architecture with gated bias correction, MESH partitions the feature space to reduce interference between different content types, leading to a 14x improvement in the power-law scaling exponent for fresh items. In online evaluations on Pinterest's Related Pins platform, MESH demonstrated a +5.5% lift in fresh-item repins, a 55% improvement in funnel efficiency, and a +0.46% improvement in user retention.

Why it matters: MESH represents a significant advance in unifying fragmented retrieval systems, improving scalability and performance for diverse content in large-scale recommendation platforms.

Jul 15, 2026

ResearchOfficialarXiv Information Retrieval

Object-Aware Token Merging Boosts Vision-Language Retrieval Efficiency

Researchers introduce SaMer, an object-aware token merging framework for multi-vector vision-language retrieval. SaMer compresses image-side tokens by over 93% while improving retrieval accuracy on benchmarks like Flickr30K and MSCOCO. The method preserves object-level evidence needed for effective retrieval, outperforming existing compression baselines and enhancing phrase-level grounding.

Why it matters: This work demonstrates that preserving object evidence, rather than merely reducing token count, is crucial for efficient and accurate multi-vector vision-language retrieval, enabling substantial storage and computation savings.

Jul 14, 2026

ResearchOfficialarXiv Information Retrieval

MG²-RAG: Multi-Granularity Graph for Multimodal Retrieval-Augmented Generation

Researchers introduce MG²-RAG, a lightweight framework that constructs a hierarchical multimodal knowledge graph by combining textual parsing with entity-driven visual grounding, enabling unified multimodal nodes. The framework features a multi-granularity graph retrieval mechanism that supports structured multi-hop reasoning and aggregates dense similarities across the graph. MG²-RAG achieves state-of-the-art performance across four multimodal tasks, while reducing graph construction overhead with significant speedup and cost reduction compared to prior graph-based methods.

Why it matters: MG²-RAG advances multimodal retrieval-augmented generation by enabling efficient, fine-grained cross-modal reasoning without relying on costly translation-to-text pipelines.

Jul 14, 2026

ResearchOfficialarXiv Information Retrieval

Cost and Accuracy of Long-Term Memory in Distributed Multi-Agent Systems Based on Large Language Models

A new independent testbed evaluates long-term memory (LTM) frameworks for LLM-based agents in distributed cloud-edge environments. The study compares mem0, Graphiti, cognee, RAG, and full-context baselines on the LoCoMo benchmark, finding that mem0, RAG, and full-context achieve 77–81% accuracy, while Graphiti and cognee reach only 55–56%. RAG matches the top accuracy at 8.4 times lower total cost of ownership than mem0, and both are the only non-dominated backends on the Pareto frontier.

Why it matters: This work provides the first independent, reproducible comparison of LTM frameworks for multi-agent systems, showing that retrieval completeness, not context volume, drives accuracy and that RAG offers the best cost-performance trade-off.

Jul 14, 2026

ResearchOfficialarXiv Information Retrieval

NAILS: Normative Alignment of Recommender Systems via Internal Label Shift

Researchers present NAILS, a method that aligns recommender system outputs with target distributions over item attributes such as fairness and diversity, without requiring retraining. NAILS adjusts the user-conditional item distribution to achieve specified marginal attribute distributions while preserving the system's learned user preferences. Experiments demonstrate that NAILS improves attribute-level alignment with minimal effect on user engagement.

Why it matters: This approach offers a scalable way to embed normative values like fairness and diversity into existing recommender systems without retraining or significant performance loss.

Jul 14, 2026

ResearchOfficialarXiv Information Retrieval

PaperRouter-Agent: Training-Free LLM Agent for Personalized Paper Routing

Researchers introduce PaperRouter-Agent, a training-free large language model (LLM) agent designed to route new academic papers into user-specific folder hierarchies by grounding its decisions in the content of folder members rather than relying solely on folder names. In tests on real personal libraries, PaperRouter-Agent improved Recall@1 from 0.39 to 0.61 and Recall@3 from 0.57 to 0.83. On the public LaMP-2 benchmark, it increased accuracy from 44.5% to 51.5% and macro-F1 by 9.0 points over a single-shot baseline.

Why it matters: This work demonstrates a significant advance in personalized information organization, showing that LLM agents can effectively route papers in reference managers without per-user training.

Jul 14, 2026

ResearchOfficialarXiv Information Retrieval

Tool-Adaptive LLM Reranker Balances Accuracy and Efficiency

Researchers introduce TALRanker, a framework that models relevance scoring as a Markov decision process, enabling large language models to selectively use external tools only when uncertain. The approach employs a two-stage training process—first preventing catastrophic forgetting, then using reinforcement learning to optimize tool invocation. TALRanker achieves state-of-the-art results on retrieval benchmarks while maintaining throughput comparable to pointwise rerankers.

Why it matters: This work offers a novel solution to the accuracy-efficiency trade-off in LLM-based reranking by enabling models to autonomously decide when to use external tools, reducing latency without compromising performance.

Jul 14, 2026

ModelsOfficialarXiv Information Retrieval

Meta Deploys RankGraph-2 for Billion-Node Graph Learning in Recommendation

Meta introduces RankGraph-2, a framework that co-designs graph construction, representation learning, and real-time serving for similarity-based retrieval at billion-node scale. The system reduces serving computational cost by 83% and achieves up to +0.96% click-through rate (CTR) and +2.75% conversion rate (CVR) improvements. RankGraph-2 has been deployed to power over 20 retrieval launches across major Meta surfaces.

Why it matters: RankGraph-2 demonstrates a significant advance in large-scale recommendation systems by jointly optimizing all stages of graph-based retrieval, resulting in notable efficiency and performance gains.

Jul 14, 2026