Text and language model news — Page 30

Language models and text-based AI systems, including reasoning, generation, and understanding of written language.

ResearchOfficialarXiv AI/ML

CoWeaver: A Bidirectional Matching Engine for Human-Agent Science Collaboration

Researchers introduce CoWeaver, a bidirectional, learnable, and explainable algorithm designed to match scientists and LLM-based agents for collaborative scientific work. The system uses two-stage ranking and uncertainty-aware capability estimates to form effective teams, and combines exploration and greedy selection strategies. Experimental results show that CoWeaver outperforms baseline methods in matching quality and efficiency across evaluated metrics.

Why it matters: This work advances the formation of effective human-AI teams in scientific research, addressing challenges in dynamic and interpretable collaboration.

ResearchOfficialarXiv Computation and Language

Adaptive Multi-Step Lookahead Decoding for Diffusion Language Models

Researchers introduce AdaLook, an adaptive lookahead framework for masked diffusion language models that dynamically adjusts rollout depth based on candidate-score variance. AdaLook enables more efficient and accurate parallel text generation by selectively deepening lookahead only when beneficial, outperforming existing one-step lookahead methods in the accuracy-efficiency trade-off across multiple benchmarks.

Why it matters: This work advances the efficiency and effectiveness of parallel text generation in diffusion language models, supporting their potential as alternatives to autoregressive models.

ResearchOfficialarXiv Computation and Language

SkillCorpus: Consolidating and Evaluating the Open Skill Ecosystem for Real-World LLM Agents

SkillCorpus aggregates and curates approximately 821,000 open-source agent skills into a set of 96,401 curated skills, organized by taxonomy and quality facets. The framework integrates a retrieval-and-selection stack that delivers consistent performance improvements across three benchmarks, with the largest gain of +7.5 percentage points on SkillsBench. The study provides an end-to-end evaluation of when a curated, retrieval-served skill corpus benefits real-world LLM agent tasks.

Why it matters: This work addresses fragmentation and quality issues in the open skill ecosystem, offering the first comprehensive evaluation of the practical impact of a curated skill corpus for LLM agents.

ResearchOfficialarXiv AI/ML

Cache-Aware Prompt Compression (CAPC) Significantly Reduces LLM API Costs

A new method called Cache-Aware Prompt Compression (CAPC) is introduced, combining query-agnostic compression with explicit cache control to optimize prompt caching for large language model (LLM) APIs. On Anthropic's Sonnet 4.6 API, CAPC achieves mean cost savings of 49% over cache-only and 64% over query-aware compression, with output quality within 0.05 of uncompressed baselines. CAPC is validated on three production workloads and is the most cost-effective strategy across all 16 LongBench-v2 configurations.

Why it matters: This work challenges the prevailing assumption that query-aware compression is optimal, demonstrating that it can be less cost-effective than caching alone, and introduces a practical approach that yields substantial real-world savings.

ResearchOfficialarXiv AI/ML

PLA Framework Achieves 100% Feasibility in On-Device Itinerary Generation, Outperforming Frontier LLMs

Researchers introduce Plan, Learn, Adapt (PLA), a three-stage framework for personalized on-device itinerary generation that guarantees 100% feasibility and achieves a 67.8% win rate in human comparisons. In contrast, leading large language models such as GPT-5, Claude Opus 4.5, and Gemini 3 Pro achieved 0% feasibility under the same constraints. In production deployment within FlyEnJoy, PLA increased itinerary completion rates by 91% with an average on-device latency of 109.9 ms.

Why it matters: This work demonstrates that combining classical optimization with lightweight learning can outperform large language models on constrained planning tasks, enabling practical and efficient mobile deployment.

ResearchOfficialarXiv Computation and Language

Process Reward Informed Tree Rollout (PATR) Improves Multi-Turn RL for LLM Agents

A new framework called Process-Scorer Guided Adaptive Tree Rollout (PATR) is proposed for multi-turn reinforcement learning (RL) in large language model (LLM) agents. PATR leverages process feedback to score partial trajectories, selectively branching from promising states and pruning unproductive paths, which enhances exploration efficiency. Experiments on SWE-Bench and FrozenLake show that PATR achieves up to +5.0 and +9.3 point improvements, respectively, over baseline methods.

Why it matters: PATR offers a more efficient approach to training RL agents for complex, long-horizon tasks, potentially advancing the capabilities of LLM-based agents in real-world applications.

ResearchOfficialarXiv Computation and Language

BIRD: Bootstrapped Iterative Self-Reasoning Distillation for Compressed Reasoning

Researchers introduce BIRD, a two-stage self-reasoning distillation method designed to improve the efficiency of large reasoning models by reducing redundant chain-of-thought traces. Applied to the Qwen3-8B model, BIRD increases MATH-500 benchmark accuracy from 86.2% to 92.0% while cutting average response length from 3,099 to 1,115 tokens. The approach addresses initialization bottlenecks in on-policy distillation by first bootstrapping concise, correct solutions before applying reverse-KL distillation. This results in a better accuracy-efficiency trade-off compared to previous methods.

Why it matters: This work provides a practical advance for making large reasoning models more efficient without sacrificing accuracy, which is important for deploying AI in resource-constrained settings.

ResearchOfficialarXiv Computation and Language

VarRate: Training-Free Variable-Rate KV Cache Compression for Long-Context LLMs

VarRate is a training-free key-value (KV) cache compression method for long-context large language models (LLMs) that assigns each token a variable low-rank budget based on query salience, ensuring all tokens are retained at nonzero rank. On the LongBench benchmark, VarRate achieves accuracy within 0.8 points of uncompressed models at a 20% memory budget, outperforming token-selection methods that suffer from irreversible token eviction and matching or exceeding other compression baselines without requiring retraining.

Why it matters: VarRate offers a practical, training-free solution to the memory bottleneck in long-context LLM inference, enabling more efficient deployment of large models on limited hardware.

ResearchOfficialarXiv AI/ML

Cura 1T: Specialized Model for Agentic Healthcare

Researchers introduce Cura 1T, a healthcare-specialized large language model (LLM) trained using a human-gated self-evolution loop. This iterative process targets improvements in patient consultation, clinical reasoning, interactive diagnosis, and EHR tool use, with each round refining the model based on observed failures. Cura 1T achieves top or near-top performance on a suite of healthcare evaluations and remains competitive on general reasoning and agentic benchmarks.

Why it matters: Cura 1T offers a novel training approach that advances specialized healthcare LLMs while maintaining general capabilities, addressing a key challenge in domain-specific AI development.

ResearchOfficialarXiv AI/ML

Empowering Users with System Control Has Mixed Effects on News Filter Bubbles

A preprint study introduced a political news recommendation system with an interface that reveals inferred user interests and allows users to adjust their news feed. The user study found that this transparency increased awareness of filter bubbles. However, the effects on news consumption were mixed: while many users shifted toward more centrist news, some used the controls to seek more extreme content, and overall political diversity sometimes decreased.

Why it matters: The findings suggest that giving users more control over recommendation systems can raise awareness of filter bubbles but may not consistently reduce polarization or increase content diversity.

ResearchOfficialarXiv AI/ML

ToolVerse: A Framework for Scaling Agentic RL with Massive Tool Environments

ToolVerse is a framework that automatically constructs large-scale agent training environments from nearly 400 real-world Model Context Protocols (MCPs), encompassing about 4,500 tools. It introduces a task design strategy based on tool dependency graphs and a Turn-Aware Relative Advantage algorithm to address credit assignment in long-horizon tasks. Experiments indicate that ToolVerse significantly improves agent performance in long-horizon tool use and enhances robust reasoning in dynamic environments.

Why it matters: ToolVerse addresses a key limitation in current agentic systems by enabling scalable training of LLM agents for complex, long-horizon tasks with real-world tool integration.

ResearchOfficialarXiv AI/ML

From Black Box to Executable Logic: Explainable Reinforcement Learning through Prolog Expert Systems

Researchers introduce a method to transform deep reinforcement learning (RL) policies into executable Prolog programs, enabling interpretability and editability. Their approach provides theoretical guarantees on return loss and fidelity, and empirical results show that the distilled logic programs can match or even exceed the performance of the original neural policies on several benchmark tasks.

Why it matters: This work offers a significant advance in making RL policies transparent and certifiable, potentially increasing trust and safety in AI decision-making.

ResearchOfficialarXiv AI/ML

Causal-Audit: Explicit and Auditable Graph-based Reasoning via Target-Aware Causal Chain Construction

A new framework, Causal-Audit, introduces explicit and auditable causal reasoning for large language models (LLMs) by constructing target-aware causal graphs and aggregating evidence from multiple reasoning paths. The method formulates causal inference as structured reasoning over explicit graphs, rather than relying on implicit language-level reasoning. Experiments on three benchmarks show that Causal-Audit outperforms existing LLM-based methods and provides interpretable, auditable reasoning traces.

Why it matters: This work offers a significant advance in making LLM reasoning more transparent and trustworthy by enabling structured, auditable causal inference.

ResearchOfficialarXiv AI/ML

DSWorld: A Data Science World Model for Efficient Autonomous Agents

Researchers present DSWorld, a framework that models data science execution environments to predict state transitions before actual execution. DSWorld integrates structured state construction, cost-aware routing, lightweight execution, and an LLM-based simulator, enabling reinforcement learning-based agent training to be accelerated by approximately 14x and search-based inference by 3-6x. The framework also outperforms the strongest LLM baseline by 35.6% on transition prediction tasks.

Why it matters: This work offers a substantial reduction in computational cost for autonomous data science agents, improving their efficiency and practicality for real-world applications.

ResearchOfficialarXiv AI/ML

Precise but Uncoupled: Reviewer Precision Does Not Guarantee Critique Uptake in Multi-Agent Math Reasoning

A study of 4,181 math problems finds that hierarchical multi-agent systems with dedicated reviewer roles do not always outperform simpler broadcast-style peer discussion, especially on harder problems. The performance gap is not due to reviewer precision—PER's reviewer is more precise (0.861 vs. 0.644)—but because critiques are less likely to be acted upon. Forcing explicit acknowledgment of critiques lowers accuracy, while embedding reviewer guidance in the solver's context helps but does not close the gap.

Why it matters: This challenges the assumption that adding a reviewer role inherently improves multi-agent reasoning, showing that the uptake of critiques is a distinct bottleneck from error detection.

ResearchOfficialarXiv AI/ML

CRAFT: Clustering Rubrics to Diagnose Weak LLM Capabilities and Generate Targeted Fine-Tuning Data

CRAFT is a method that transforms rubric-based evaluation datasets into model-specific diagnoses of weak capabilities by treating each grading criterion as a capability probe. It clusters these capability descriptions into a hierarchical tree, scores the model at each node, and selects low-performing nodes to generate targeted supervised fine-tuning data. In experiments on four open-source models in finance and legal domains, CRAFT outperformed baseline methods in most settings, leading to improved model performance after targeted fine-tuning.

Why it matters: CRAFT enables more precise identification and remediation of model weaknesses, supporting more effective targeted fine-tuning and improved model capabilities.

ResearchOfficialarXiv AI/ML

GraphDx: A Cost-Aware Multi-Agent Framework for Sequential Diagnosis

GraphDx is a knowledge-enhanced multi-agent framework designed for sequential medical diagnosis that aims to balance diagnostic accuracy with resource costs. It leverages large language models to construct Medical Diagnosis Knowledge Graphs and employs three collaborative agents—Perception, Reasoning, and Decision—for systematic information gathering and decision-making. Experiments on MedQA and MIMIC-IV datasets demonstrate that GraphDx improves diagnostic success rates from 50–68% to 79–93% while reducing test costs by 20–54%.

Why it matters: This framework offers a potentially more cost-effective and interpretable approach to automated clinical diagnosis by integrating LLM knowledge with structured, cost-aware reasoning.

People & InstitutionsOfficialCSET (Center for Security and Emerging Technology)

Helen Toner Discusses U.S.-China AI Race at Aspen Ideas Festival

CSET Executive Director Helen Toner spoke about the global AI competition at the Aspen Ideas Festival. Her discussion focused on the ongoing AI race between the U.S. and China.

Why it matters: This underscores the importance of high-level discussions on international AI competition, particularly between the U.S. and China.

Companies & FundingOfficialCSET (Center for Security and Emerging Technology)

Companies turn to Chinese AI models to cut costs

Companies worldwide are increasingly adopting Chinese AI models, attracted by their lower costs, improving capabilities, and the flexibility of open-weight systems. CSET’s Sam Bresnick provided expert insight on this trend in a Financial Times article.

Why it matters: This shift could reshape the global AI landscape by challenging the dominance of Western AI providers and influencing cost dynamics and accessibility.

Policy & SafetyOfficialCSET (Center for Security and Emerging Technology)

FLARE-AI Platform Launches for Reporting Harmful AI Behavior

A new crowdsourced platform called FLARE-AI has launched to centralize the reporting of harmful AI behavior and model flaws. The platform is designed to improve transparency and accountability in AI systems, with expert insight provided by CSET's Jessica Ji in a WIRED article.

Why it matters: FLARE-AI could increase accountability and safety in AI development by providing a centralized system for reporting AI harms.