What changed in AI — Page 103

ResearchOfficialarXiv Machine Learning

Ablation, Statistical Inference, and Validation for KV-Cache Compression

This study systematically compares Turbo-Quant and SpectralQuant KV-cache compression methods, using a statistical validation methodology to evaluate non-dominated schemes. The research finds that eigenbasis-based methods perform poorly on heavy-tailed data due to covariance instability but excel in structured regimes, with the effective semantic dimension adapting to calibration budgets rather than true data rank.

Why it matters: The work provides a rigorous framework for evaluating KV-cache compression techniques, which is important for optimizing memory and latency in large language model inference.

ResearchOfficialarXiv Information Retrieval

PaperRouter-Agent: Training-Free LLM Agent for Personalized Paper Routing

Researchers introduce PaperRouter-Agent, a training-free large language model (LLM) agent designed to route new academic papers into user-specific folder hierarchies by grounding its decisions in the content of folder members rather than relying solely on folder names. In tests on real personal libraries, PaperRouter-Agent improved Recall@1 from 0.39 to 0.61 and Recall@3 from 0.57 to 0.83. On the public LaMP-2 benchmark, it increased accuracy from 44.5% to 51.5% and macro-F1 by 9.0 points over a single-shot baseline.

Why it matters: This work demonstrates a significant advance in personalized information organization, showing that LLM agents can effectively route papers in reference managers without per-user training.

ResearchOfficialarXiv Machine Learning

Output-aware safety guardrail reduces over-refusal in MLLMs

Researchers introduce an output-aware safety guardrail for multimodal large language models (MLLMs) that predicts unsafe generations from hidden states, rather than relying solely on input analysis. Their method achieves safety performance comparable to existing approaches but significantly reduces over-refusal, thereby maintaining the model's utility and leveraging its intrinsic safety mechanisms.

Why it matters: This work offers a practical advance in balancing safety and usability for MLLMs by enabling more targeted safety interventions and reducing unnecessary refusals.

ResearchOfficialarXiv Information Retrieval

Tool-Adaptive LLM Reranker Balances Accuracy and Efficiency

Researchers introduce TALRanker, a framework that models relevance scoring as a Markov decision process, enabling large language models to selectively use external tools only when uncertain. The approach employs a two-stage training process—first preventing catastrophic forgetting, then using reinforcement learning to optimize tool invocation. TALRanker achieves state-of-the-art results on retrieval benchmarks while maintaining throughput comparable to pointwise rerankers.

Why it matters: This work offers a novel solution to the accuracy-efficiency trade-off in LLM-based reranking by enabling models to autonomously decide when to use external tools, reducing latency without compromising performance.

InfrastructureOfficialarXiv Machine Learning

Quota Marketplace: Dynamic Pricing for Efficient Allocation of ML Training Resources

Google researchers introduce Quota Marketplace, a market-based system for allocating ML training chips such as GPUs using dynamic pricing to accommodate workloads with varying values. The system, implemented and deployed at Google, is designed to achieve Pareto efficiency and max-min fairness, and to better align resource allocation with organizational priorities. The paper details both the theoretical foundations and practical deployment, including metrics demonstrating its impact.

Why it matters: Efficient allocation of scarce ML training resources is a major challenge for organizations, and this work demonstrates a practical, scalable solution that addresses heterogeneous workload values.

ResearchOfficialarXiv Machine Learning

Low-Rank Attention Residuals Enable More Efficient LLM Routing

A new preprint introduces Low-Rank Attention Residuals (LR-AttnRes), a method that uses low-dimensional keys for depthwise routing in large language models (LLMs) while retaining full-dimensional residual values. This approach decouples routing from representation, leading to improved validation loss and reduced computational cost. The authors present two variants—Projected and Sliced LR-AttnRes—and release code and models for further research.

Why it matters: The work demonstrates that effective depthwise routing in LLMs can be achieved with significantly fewer dimensions, suggesting a path toward more efficient model architectures.

ModelsOfficialarXiv Information Retrieval

Meta Deploys RankGraph-2 for Billion-Node Graph Learning in Recommendation

Meta introduces RankGraph-2, a framework that co-designs graph construction, representation learning, and real-time serving for similarity-based retrieval at billion-node scale. The system reduces serving computational cost by 83% and achieves up to +0.96% click-through rate (CTR) and +2.75% conversion rate (CVR) improvements. RankGraph-2 has been deployed to power over 20 retrieval launches across major Meta surfaces.

Why it matters: RankGraph-2 demonstrates a significant advance in large-scale recommendation systems by jointly optimizing all stages of graph-based retrieval, resulting in notable efficiency and performance gains.

ResearchOfficialarXiv Information Retrieval

Adaptive Model Compression (AMC): Saliency-Driven Resource Allocation for Ultra-Low-Power Transformer Inference

Researchers have introduced Adaptive Model Compression (AMC), a framework that dynamically allocates hardware resources during transformer inference based on token saliency. AMC uses a multi-tier architecture to process important tokens at full precision while compressing less significant data, resulting in a 59.2% reduction in system energy and a 2.24x increase in throughput on 45nm CMOS hardware, with only a 3.6% drop in accuracy.

Why it matters: This approach could make it feasible to run large transformer models efficiently on edge devices, significantly improving battery life without major performance loss.

ResearchOfficialarXiv Machine Learning

EvoClawBench: Benchmarking Agents' Ability to Learn Reusable Skills from Their Own Runs

EvoClawBench is a new benchmark designed to test whether AI agents can transform evidence from their own runs into reusable skills that improve future executions. The benchmark covers 100 tasks across coding, data, office, security, operations, and domain-document workflows, and supports multiple agent runtimes. Experiments with OpenClaw and nanobot show that the ability to learn reusable skills is selective and cost-sensitive: some models improve with skill learning, while others experience performance drops or collapse. This demonstrates that skill learning from experience is not an automatic benefit for agent systems.

Why it matters: This work isolates and rigorously tests a critical capability for autonomous agents—learning from their own experience—and shows that it is not guaranteed, informing the design of more robust agent systems.

ResearchOfficialarXiv Machine Learning

Spectral Origins of the Self-Correction Blind Spot in Autoregressive Generation

A new preprint introduces SPARC, a spectral-algebraic theory that formally explains why autoregressive language models (LLMs) often fail to correct their own errors but can fix identical errors when attributed to external sources. The theory proves that this 'self-correction blind spot' arises when the spectral radius of the error-propagation operator is at least one, and it derives a precise activation threshold for correction markers. Experiments across four model backbones and a visual autoregressive probe validate the theory, with predictions matching observed blind-spot rates within 3.2% RMSE.

Why it matters: This work provides the first formal, quantitative model of the self-correction blind spot in autoregressive generation, offering new insights that could improve the reliability of LLMs and related models.

Policy & SafetyOfficialarXiv Computers and Society

The Benchmark Ceiling: Human Judgment, Evaluation Scarcity, and the Political Economy of AI Capability Measurement

A new preprint argues that as AI models approach top performance on existing benchmarks, the remaining discriminating items are those requiring elite expert judgment, which is structurally scarce. The authors present a formal model showing how benchmark signal depreciates as models improve, and document a scarcity premium for high-judgment evaluation labor. The paper also discusses the governance implications of these findings for AI capability measurement.

Why it matters: This work highlights a fundamental bottleneck in evaluating advanced AI systems, raising concerns about the reliability of current benchmarks and the challenges for AI governance.

ResearchOfficialarXiv Information Retrieval

CORE-Bench: A Comprehensive Benchmark for Code Retrieval in the Era of Agentic Coding

Researchers present CORE-Bench, a new benchmark designed to evaluate code retrieval in agentic coding scenarios. The benchmark assesses models on code understanding, issue-to-edit localization, and broader context retrieval, using over 180,000 queries and 106,000 relevance labels. Results show that current embedding models perform poorly on these tasks, but simple supervised fine-tuning leads to notable improvements, highlighting significant room for advancement.

Why it matters: CORE-Bench fills a critical gap in evaluating code retrieval for AI coding agents, supporting the development of more capable systems for navigating and understanding code repositories.

ResearchOfficialarXiv Information Retrieval

GRASP: RL Framework for Adaptive Retrieval in Agentic RAG

Researchers introduce GRASP, a reinforcement learning framework that enables agents to adaptively coordinate semantic search, keyword search, and paragraph reading during multi-step reasoning. The policy learns to control context granularity, leading to improved retrieval recall and question answering performance on multi-hop benchmarks. The learned strategies include interpretable skimming and scanning behaviors.

Why it matters: This work advances agentic retrieval-augmented generation by enabling dynamic and context-aware retrieval strategies, which are important for accurate multi-step reasoning.

ResearchOfficialarXiv Information Retrieval

ARGUS-EVAL Framework Reveals Capability-Reliability Gap in Vision-Language Models

Researchers have introduced ARGUS-EVAL, a new evaluation framework that assesses Vision-Language Models (VLMs) not only on their benchmark capabilities but also on cross-dataset consistency, robustness, and efficiency. Testing models such as Qwen-2.5VL-3B-Instruct and CLIP, the study finds that models with similar benchmark scores can differ significantly in reliability and efficiency. Qwen-2.5VL-3B-Instruct demonstrates the highest overall capability, while CLIP stands out for its efficiency.

Why it matters: ARGUS-EVAL provides a more comprehensive way to evaluate and select VLMs for real-world applications by highlighting differences in reliability and efficiency that are not captured by standard benchmarks.

ResearchOfficialarXiv Machine Learning

SciML in the Wild: Structural Priors Can Hurt When Mismatched

A new preprint evaluates Scientific Machine Learning (SciML) methods for macroeconomic forecasting and finds that structural priors can act as misregularizers when they do not align with the true data-generating process. In tests across 23 countries, less-constrained models like ARIMA and Neural ODEs consistently outperformed more-constrained models such as PINNs and UDEs. The study highlights the challenges of low-frequency macroeconomic prediction and cautions that more structural assumptions do not always yield better results.

Why it matters: This work challenges the assumption that adding structural priors always improves model performance, offering important guidance for SciML practitioners.

ResearchOfficialarXiv Information Retrieval

SVD-RAG: Efficient Tree-Organized Retrieval-Augmented Generation via Singular Value Decomposition

SVD-RAG introduces the use of Singular Value Decomposition (SVD) on dense sentence embeddings for extractive summarization in hierarchical Retrieval-Augmented Generation (RAG) systems, replacing the need for expensive LLM-based summarization. The method achieves retrieval quality within 1-5% of RAPTOR while constructing the retrieval tree 317 times faster and reducing token consumption by approximately 85%. SVD-RAG is deterministic, cost-efficient, and adapts to content complexity automatically.

Why it matters: This approach makes hierarchical RAG systems significantly more practical and scalable by reducing computational cost and latency without substantially sacrificing retrieval quality.

ResearchOfficialarXiv Audio and Speech Processing

PhoneticXEUS Sets New Benchmark in Multilingual Phone Recognition

Researchers introduce PhoneticXEUS, a model trained on large-scale multilingual data that achieves state-of-the-art phone recognition error rates: 17.7% on multilingual speech and 10.6% on accented English. The study systematically quantifies the effects of self-supervised learning representations, data scale, and loss objectives through controlled ablations across over 100 languages. All data and code are released openly.

Why it matters: This work provides a robust, open-source approach for universal phone recognition, advancing multilingual and low-resource speech processing.

Policy & SafetyOfficialarXiv Cryptography and Security

GATAS: Black-Box Testing of ASR Systems via Phoneme-Level Latent Space Optimization

Researchers have introduced GATAS, a black-box testing method that generates adversarial inputs for automatic speech recognition (ASR) systems by interpolating in the phoneme-level latent space of a text-to-speech model. GATAS achieves a 98% success rate in inducing transcription errors while maintaining high perceptual quality, outperforming both white-box and black-box baselines. The study finds that representation and perceptual alignment are more important than gradient access for generating effective adversarial test cases.

Why it matters: This work reveals a significant new vulnerability in ASR systems, showing that adversarial attacks can be highly effective even without access to model internals, which has important implications for the security of voice-driven applications.

ResearchOfficialarXiv Information Retrieval

PTFEA: A Curriculum Learning Framework Unifying Context Engineering and Fine-Tuning for Multimodal Entity Alignment

A new preprint introduces PTFEA, a curriculum-learning-inspired framework that mathematically unifies context engineering and fine-tuning for Multimodal Entity Alignment (MMEA). PTFEA adapts information injection stages based on confidence thresholds and uses progressive inference to mirror fine-tuning processes. Experiments on five public datasets show PTFEA consistently outperforms strong baselines, achieving over 80% reduction in runtime and token consumption compared to prior context-engineering methods, while narrowing the performance gap between large and small models.

Why it matters: PTFEA offers a theoretically grounded and highly efficient alternative to traditional fine-tuning for MMEA, potentially lowering computational costs and broadening access to high-performance multimodal alignment.

ResearchOfficialarXiv Audio and Speech Processing

GigaChat Audio: Time-aware Large Audio Language Model

Researchers introduce a time-aware audio large language model (LLM) capable of answering questions with explicit timestamps over audio inputs up to 120 minutes long. The model interleaves periodic time markers with continuous audio tokens, trained using large-scale synthetic supervision. It demonstrates strong temporal-grounding accuracy on both short and long audio benchmarks and supports time-anchored fragment descriptions and summaries.

Why it matters: This work enables precise temporal grounding in long audio recordings, advancing applications such as meeting analysis and media indexing.