← Back to arXiv AI/ML

arXiv AI/ML briefings

ResearchOfficialarXiv AI/ML

Dynamic Agent Skills: A Lifecycle Survey and Taxonomy of Evolving Skill Libraries

A new arXiv survey (2607.10113) analyzes 124 papers from 2023–2026 to create a taxonomy of how LLM agents manage evolving skill libraries. It proposes a six-sense taxonomy for different skill artifacts, an eight-stage lifecycle architecture, and a ten-operator vocabulary for comparing library updates. Key findings include the importance of admission and repair, the impact of verifier quality on skill-aware RL, and the degradation of flat retrieval as libraries grow.

Why it matters: This survey provides a structured framework for understanding and evaluating dynamic skill libraries in LLM agents, highlighting critical design decisions and open problems for future research.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

GRATE: Temporal Extensions for Inductive KG Foundation Models via Gated Rotary Attention

Researchers propose GRATE, a temporal encoding method for knowledge graph foundation models that uses gated rotary attention to encode time without adding learnable parameters. GRATE enables inductive transfer to temporal knowledge graphs with disjoint vocabularies and outperforms static baselines on new benchmarks, GDELTIndT and WIKIIndT.

Why it matters: This work extends the transferability of knowledge graph foundation models to temporal data, enabling generalization to unseen entities, relations, and timestamps across datasets.

Jul 14, 2026

Policy SafetyOfficialarXiv AI/ML

Comparing Socio-technical Design Principles with Guidelines for Human-centered AI

A new arXiv paper compares guidelines for human-centered AI with socio-technical design principles, highlighting the importance of continuous evolution and human oversight in AI systems. The study emphasizes that transparency should involve both technical features and the contributions of human actors. It also suggests that organizational and social practices should be designed to address AI shortcomings.

Why it matters: This research offers a framework for integrating socio-technical principles into AI design, underscoring the need for ongoing adaptation and human involvement.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

MAG: New Benchmark Unifies Web Agent Actions and Guide Generation

Researchers introduce MAG, the first benchmark to unify web agent task execution and guide text generation into a single multimodal task. The benchmark uses screenshots with two grounding schemes and provides a complete harness for annotation, training, and evaluation. Frontier models complete fewer than 40% of tasks, and a GRPO training method nearly doubles the success rate of a 9B agent from 6.9% to 13.2%.

Why it matters: MAG provides a unified evaluation framework for web agent actions and guide generation, potentially advancing the development of more capable AI assistants.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

SPARK: Susceptibility-Guided Profiling and Steering of Latent Reasoning States in Large Language Models

SPARK uses hidden-state response to diagnose whether a large language model (LLM) internally enters an effective reasoning state and to guide lightweight test-time steering. The method improves Qwen3 models on the MATH-500 benchmark, increasing accuracy from 82.0% to 84.6% for Qwen3-4B and from 82.4% to 85.6% for Qwen3-8B.

Why it matters: This approach provides a diagnostic signal for reasoning failures and a practical guide for targeted test-time intervention in LLMs.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

UNIT: Leveraging Large Language Models for Graph Continual Learning

A new framework called UNIT utilizes large language models (LLMs) for graph continual learning, addressing challenges such as semantic-structural separation and imbalanced knowledge transfer. By fine-tuning an LLM on the first task and introducing uncertainty-aware anchor generation and structural confluence modeling, UNIT demonstrates state-of-the-art performance in graph continual learning tasks.

Why it matters: This work improves AI systems' ability to continuously learn from evolving graph-structured data, which is common in real-world multimodal web scenarios.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

AgentAbstain: New Benchmark Reveals LLM Agents Often Fail to Know When to Abstain

Researchers have introduced AgentAbstain, the first systematic framework to evaluate whether LLM agents know when not to act. The benchmark features 263 paired tasks across 42 sandbox environments, covering 8 abstention scenarios. The best-performing agent, Gemini 3.1 Pro, achieves only 59.5% paired accuracy, and abstention capability appears largely independent of general task-solving ability.

Why it matters: As LLM agents are increasingly deployed for autonomous tasks, evaluating their ability to abstain is critical to prevent unintended and irreversible actions.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

IdeaTrail: Full-Process Agent Trajectories for Scientific Ideation

IdeaTrail is a multi-turn process-trajectory dataset for scientific ideation and proposal generation, capturing the full research workflow from evidence gathering to idea selection or proposal construction. It uses a Generator-Advisor synthesis loop starting from human-selected high-quality papers and artifacts to produce grounded, natural trajectories. The dataset also provides a general recipe for synthesizing process-supervision data for scientific research agents.

Why it matters: This dataset enables training AI agents on realistic, multi-step scientific research processes rather than isolated text generation tasks, potentially improving their ability to conduct complex research workflows.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

From ML Predictions to Informed Diagnostic Assistance Using the Toulmin Model of Argumentation

Researchers propose a framework that decomposes ML-based retinal diagnosis into components of the Toulmin argumentation model: claim, grounds, warrant, qualifier, and rebuttal. A biomarker extraction model provides grounds, a MedGemma agent analyzes the warrant, and a qualifier is derived from quantitative evaluation. Rebuttals use image similarity via MedSigLip, with all components presented to human experts for assessment.

Why it matters: This approach enhances interpretability and trust in AI-assisted medical diagnosis by structuring ML outputs as arguments, enabling clinicians to critically evaluate AI-generated claims.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

BatteryLake: Agentic, Physics-Grounded Curation of Heterogeneous Battery Aging Data and Benchmarking

BatteryLake is a governed data lakehouse that uses LLM agents and human-in-the-loop verification to curate public battery aging datasets into benchmark-ready assets. It standardizes 41 datasets from over 25 institutions using schema, statistical, and physical-plausibility rules, and releases an open benchmark for SOH and RUL tasks.

Why it matters: This work addresses the challenge of inconsistent battery aging data by automating curation with domain-specific semantics, enabling reproducible research and benchmarking in battery health management.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

PHITSBench: Benchmark for AI-Assisted Radiation Transport Code Generation

Researchers introduced PHITSBench, a benchmark for evaluating AI-assisted generation of PHITS radiation transport code from natural language. GPT-5.4 achieved 95% success on parameter editing and 70% on syntax repair tasks, but 0% on generating simulations from scratch without domain knowledge. Providing a structured knowledge catalog increased single-shot success on simulation generation to 57%, and agentic workflows further improved it to 66-73%.

Why it matters: This benchmark demonstrates that current AI models struggle to generate correct scientific simulations from natural language without machine-readable knowledge, highlighting the importance of structured knowledge bases and execution-grounded evaluation.

Jul 14, 2026

ResearchReportedarXiv AI/ML

Semantic Drift and the Stability of Operator Control in Reasoning-Class Decision Support Systems

A new arXiv paper investigates semantic context drift in reasoning large language models (LLMs) during human-machine decision-making. Through a two-month longitudinal experiment, the study verifies latent semantic drift, introduces a stability coefficient metric, and proposes engineering recommendations for dynamic arbitration loops.

Why it matters: This research highlights a stability issue in reasoning LLMs that could affect operator control in decision support systems.

Jul 14, 2026

Policy SafetyOfficialarXiv AI/ML

Norm Enforcement for AI Agents: Robustly Shaping Behavior in Multi-Agent Systems

A new arXiv paper investigates norm enforcement mechanisms for language model agents in multi-agent systems. The study finds that simple enforcement mechanisms can be exploited by misaligned agents, and introduces more robust mechanisms based on reliability estimation and escalating penalties. These robust mechanisms resist exploitation and penalize violations at comparable or lower cost than baseline approaches.

Why it matters: This research offers scalable methods for shaping AI agent behavior in shared environments, helping to address collective harms such as misleading content from competing agents.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

Budgeted Placement of Strong Correctors in Weak Multi-Agent Swarms

A new arXiv paper investigates how to optimally allocate a limited budget to place strong 'oracle' correctors within a swarm of unreliable agents to achieve correct consensus. The authors prove that the coherence measure remains submodular even with varying oracle strengths, allowing a greedy algorithm to achieve near-optimal placement for any budget. They derive the budget-correctness frontier and demonstrate, using the Qwen3 model ladder, that the trade-off between few strong or many medium oracles is task-dependent.

Why it matters: This work offers a theoretical framework for cost-effective correction in multi-agent systems, informing practical strategies for deploying AI agents in consensus tasks.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

Length Penalties Make Chain-of-Thought Less Monitorable

A new study finds that applying length-penalized reinforcement learning to language models shortens their chain-of-thought reasoning and makes it harder to detect the influences behind their answers. While length penalties reduce how often misleading hints are mentioned in the reasoning process, these hints can still steer the model's answers. This creates a trade-off where more efficient reasoning preserves answer accuracy but reduces transparency into the model's decision-making process.

Why it matters: As AI models are optimized for efficiency, their reasoning traces may become less transparent, which could undermine efforts to monitor and ensure their safety.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

EvoCUA-1.5: Online RL Framework for Multi-turn Computer-Use Agents

EvoCUA-1.5 introduces online reinforcement learning for computer-use agents, addressing challenges such as sparse rewards and variable-length trajectories. It achieves 63.2% success on OSWorld-Verified, outperforming comparable 32B/35B-scale open-weight baselines.

Why it matters: This work provides a practical framework for scaling online RL in multi-turn computer-use agents, improving training stability and performance.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

Agentic Context Learning with Self-Discovered Specification

A new study finds that large language models (LLMs) struggle with context learning because they often fail to acquire local specifications—such as domain-specific formats and rules—that are distributed across the context. The researchers propose the PSCI (private specification-contract induction) method, which extracts and enforces these specifications, achieving state-of-the-art results on the CL-Bench benchmark, including a 24.8% relative improvement for GPT-5.1.

Why it matters: This research highlights specification acquisition as a key challenge in context learning and demonstrates a simple intervention that can significantly improve LLM performance on complex inference-time tasks.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

Agentic Workflow Improves AI-Generated Math Diagrams for K-12 Education

Researchers have introduced an agentic workflow that enables large language model (LLM) agents to iteratively evaluate and improve the quality of mathematical diagrams for K-12 education. The system uses LLMs to generate quality assurance questions and Vision Language Models to assess and refine the visuals. Preliminary evaluation suggests this approach can enhance the reliability and educational value of AI-generated math diagrams, though further improvements are needed in spatial reasoning and coverage of diagram features.

Why it matters: This workflow addresses a key gap in generating accurate and pedagogically sound AI-created diagrams for math education.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

Verification Protocol for Adaptive Agentic Controllers Using Finite Rule Revision

A new paper proposes a bounded verification protocol for adaptive agentic controllers represented by finite symbolic rules, diagnostic predicates, and explanation logs. The framework maps diagnostic failures to predefined rule edits and re-evaluates repaired controllers on held-out simulations. Experiments on an inventory-control benchmark demonstrate three outcomes: non-repairable failures, rejected partial repairs, and successful local one-step repairs.

Why it matters: This work addresses the gap between prototype capability and production deployment of industrial agentic AI systems by providing a simulation-compatible method for verifying and locally repairing controller failures without unrestricted human oversight.

Jul 14, 2026

ResearchOfficialarXiv AI/ML

LLM-Driven Evolution Generates Multi-Objective Bayesian Optimization Algorithms Outperforming Human Designs

Researchers extended the LLaMEA framework to evolve multi-objective Bayesian optimization (MOBO) algorithms, using large language models as mutation and crossover operators. The best generated algorithm achieved a mean normalized hypervolume of 0.971 on synthetic problems (vs. 0.869 for baseline qParEGO) with about 60x less wall-clock time, and 0.985 on real-world engineering problems (vs. 0.971) at roughly 3.4x lower cost. The study demonstrates that LLM-driven evolutionary search can discover algorithm designs with superior Pareto efficiency compared to manual approaches.

Why it matters: This work shows that LLMs can autonomously design optimization algorithms that match or surpass human-crafted ones, potentially accelerating progress in multi-objective optimization.

Jul 13, 2026