Research→Official→arXiv AI/ML
A new preprint introduces the Harness Handbook, an automatically generated, behavior-centric representation of agent harness codebases created through static analysis and LLM-assisted structuring. The paper also presents Behavior-Guided Progressive Disclosure (BGPD), a method to help developers and coding agents efficiently locate code implementing specific behaviors. Experiments on two open-source harnesses demonstrate that Handbook-Assisted planning improves behavior localization and edit-plan quality while reducing token usage, especially for complex or distributed code changes.
Why it matters: This work addresses a major challenge in evolving complex AI agent systems by automating the mapping from high-level behaviors to relevant code locations, potentially streamlining development and maintenance.
Jul 16, 2026
Research→Official→arXiv AI/ML
Researchers have introduced UESF-Bench, a large-scale benchmark designed for embodied agents that must first locate a language-described person and then follow them in dynamic environments. They also present SeekFollow-VLA, a vision-language-action framework that demonstrates improved performance over existing baselines in both single- and multi-person scenarios.
Why it matters: UESF-Bench enables more realistic evaluation of embodied agents by combining search and follow tasks, which is important for advancing applications such as assistive robotics.
Jul 16, 2026
Research→Official→arXiv AI/ML
A new benchmark, STOCKTAKE, evaluates large language model (LLM) agents on a 26-week supply-chain replenishment task, explicitly separating state estimation from action. The study finds that while models can detect 84-88% of hidden failures, their actions often underperform a symptom-blind baseline, exposing a knowing-doing gap where correct diagnosis does not ensure effective intervention.
Why it matters: STOCKTAKE offers a novel method to disentangle perception from action failures in LLM agents, which is crucial for improving their reliability in complex, real-world decision-making tasks.
Jul 16, 2026
Research→Official→arXiv AI/ML
A new method called LAPO introduces self-generated process supervision for multi-turn search reasoning by using backward leave-one-turn attribution. LAPO estimates the contribution of each search turn by measuring the change in the policy's likelihood of the correct answer when a turn is removed, and applies sign-consistency gating to refine these process rewards. Tested across seven knowledge-intensive QA datasets, LAPO achieves an average exact-match score of 0.326, outperforming the IGPO baseline by 0.053, without requiring additional reward models or external supervision.
Why it matters: LAPO demonstrates a practical approach to improving multi-turn search reasoning by enabling fine-grained process supervision using only the policy itself, potentially reducing reliance on external resources.
Jul 16, 2026
Infrastructure→Official→arXiv AI/ML
A new preprint from Oracle introduces Agent Memory, a database-native memory substrate designed for long-horizon AI agents and built on Oracle Database. The system organizes memory as a lifecycle—including ingestion, extraction, consolidation, retrieval, summarization, and revision—and separates active memory from passive storage with explicit scope control. In evaluations, Agent Memory achieved 93.8% accuracy on LongMemEval while using about 10.7 times fewer tokens than flat-history baselines.
Why it matters: This work proposes a scalable, database-integrated memory layer that could improve efficiency and accuracy for AI agents operating over extended timeframes.
Jul 16, 2026
Research→Official→arXiv AI/ML
A new preprint demonstrates that both classical causal discovery and existing LLM-based multi-agent systems struggle to reliably identify root causes in production microservice failures using the OpenRCA dataset. The authors introduce a Structured Multi-Agent RCA pipeline that significantly outperforms these baselines and propose a reverse reasoning agent to diagnose failures as stemming from either reasoning gaps or data ambiguity. Their analysis shows that the main bottleneck is not data access but the agent's reasoning ability, highlighting the need for improved model-level reasoning.
Why it matters: This work clarifies that advances in model reasoning, rather than data pipeline improvements, are crucial for effective root cause analysis in complex telemetry data.
Jul 16, 2026
Research→Official→arXiv AI/ML
UrbanAgent is a new framework that approaches urban region profiling as a reasoning-driven inference task, using multiple agents—each dedicated to a specific data modality—to address inconsistencies across data types. The system incorporates tool-augmented evidence retrieval and reinforcement learning, enabling agents to actively acquire and verify information. Experiments on global datasets for carbon emissions, GDP, and population estimation show UrbanAgent achieves an average 8.1% improvement in R2 over existing methods and demonstrates strong generalization to unseen cities.
Why it matters: This work presents a novel agent-based approach that improves the robustness and generalization of urban region profiling by explicitly reasoning over multimodal data, moving beyond traditional correlation-based methods.
Jul 16, 2026
Research→Official→arXiv AI/ML
A new preprint introduces Safety Sentry, a guard model for LLM agents that routes actions into three categories: EXECUTE, ASK, or REFUSE, rather than using only binary safe/unsafe labels. The model enables per-instance, context-aware decisions and allows risk tolerance to be adjusted at inference time with a single threshold, without retraining. Safety Sentry demonstrates improved accuracy and safety recall compared to both open-weight and closed-source baseline models.
Why it matters: This work proposes a more nuanced and flexible approach to LLM agent safety, potentially reducing unnecessary interruptions while improving harm prevention.
Jul 16, 2026
Research→Official→arXiv AI/ML
AgentCompass is an open-source, lightweight, and extensible infrastructure designed for evaluating LLM-based agents. It structures evaluation around three independent components—Benchmark, Harness, and Environment—allowing flexible configurations without reimplementing complex logic. The system includes a fault-tolerant asynchronous runtime and trajectory analysis tools to diagnose nuanced failure modes, such as reward-hacking, and natively supports over 20 benchmarks across five capability dimensions.
Why it matters: AgentCompass aims to address fragmentation and reproducibility challenges in agent evaluation pipelines by providing a unified and scalable infrastructure for agent research.
Jul 16, 2026
Policy Safety→Official→arXiv AI/ML
A new preprint introduces a mathematical framework for underwriting, pricing, and designing insurance contracts tailored to autonomous AI systems. The model represents deployments using risk factors such as autonomy level, governance maturity, and permission exposure, and maps these to insurance parameters like premiums and coverage. The paper also analyzes structural properties of insurability and demonstrates the approach with a healthcare case study.
Why it matters: This work provides a foundational approach to managing and pricing risk for autonomous AI agents, addressing a gap in current insurance and regulatory practices.
Jul 16, 2026
Research→Official→arXiv AI/ML
OriginBlame is a new system that enables record- and token-level data provenance tracking for AI training datasets. It allows precise identification of training records associated with specific data contributors, facilitating targeted unlearning requests. In experiments on Wikipedia data, OriginBlame reduced over-deletion from 101x to 1.3x and improved unlearning effectiveness by 42% compared to random baselines.
Why it matters: This system offers a significant advance in AI data governance by enabling precise data removal, reducing unnecessary data loss during unlearning processes.
Jul 16, 2026
Research→Official→arXiv AI/ML
A new evaluation framework called Elenchos assesses large language models' (LLMs) ability to perform abductive reasoning by having them infer hidden mutations in formal systems. The study finds that both frontier and mid-tier LLMs can often detect that a system has changed but struggle to accurately identify the specific underlying mutations. Performance drops further when multiple interacting mutations are present, and increasing inference-time reasoning yields only modest gains.
Why it matters: This work exposes a key limitation in LLMs' reasoning abilities, highlighting a gap between detecting anomalies and understanding their causes, which is important for applications requiring reliable causal inference.
Jul 15, 2026
Research→Official→arXiv AI/ML
A controlled study of Group Relative Policy Optimization (GRPO) on 4B-8B parameter language and vision-language web agents found that no configuration improved upon a strong supervised baseline. Moderate to high learning rates led to credible performance degradation, particularly on text-based tasks. The study attributes this failure to learning-rate-gated degradation and collapse regimes, with effects that are dependent on model scale.
Why it matters: This work challenges the assumption that reinforcement learning with verifiable rewards reliably improves small agents, identifying specific failure modes tied to learning rate and model scale.
Jul 15, 2026
Research→Official→arXiv AI/ML
A new neuro-symbolic approach integrates a Maximum Satisfiability (MaxSAT) oracle with Vision-Language Models (VLMs) to improve their performance on Sudoku puzzles. The MaxSAT solver identifies consistent subsets of VLM-generated assignments and provides structured feedback, guiding the models to refine their solutions. Experiments across multiple VLMs show that this method enhances logical consistency and increases the number of correctly solved Sudoku instances.
Why it matters: This work shows that symbolic optimization can significantly improve the reliability of vision-language models on structured reasoning tasks.
Jul 15, 2026
Research→Official→arXiv AI/ML
A new preprint introduces a framework for co-evolving evaluation metrics alongside skills in self-improving large language model (LLM) agents, addressing the common but often unexamined assumption that reliable evaluation metrics are already available. The proposed Double Ratchet system demonstrates that co-evolved metrics can retain 88–110% of the performance improvement ('lift') achieved by ground-truth-driven skill loops across tasks such as code generation, text-to-SQL, and report generation. The approach incorporates safety mechanisms like anchor discipline and external audits to mitigate metric gaming and ensure transparency.
Why it matters: This work offers a practical and auditable method for evolving evaluation metrics in autonomous AI systems, potentially making self-improving agents more robust and trustworthy in real-world applications where ground-truth metrics are unavailable.
Jul 15, 2026
Research→Official→arXiv AI/ML
Researchers introduce Light-MER, a multimodal emotion recognition model with fewer than 1 billion parameters, designed to achieve high performance through knowledge distillation from larger models. The framework incorporates optimal transport loss and a multi-reward optimization strategy to balance accuracy and efficiency. Experiments on nine benchmark datasets show that Light-MER achieves state-of-the-art results while enabling faster inference, making it suitable for deployment on resource-constrained devices.
Why it matters: This work demonstrates that high-quality multimodal emotion recognition is possible with much smaller models, enabling practical deployment on devices with limited computational resources.
Jul 15, 2026
Research→Official→arXiv AI/ML
Researchers introduced Pythia, a multi-agent system that autonomously generates and optimizes prompts for extracting clinical symptoms from notes, without manual prompt engineering or model fine-tuning. Using a locally hosted open-weights language model, Pythia achieved a mean sensitivity of 0.76 and specificity of 0.95 across 72 signs and symptoms from 400 clinical notes, outperforming a curated lexicon in specificity and matching or exceeding it on both metrics for many concepts. The system preserves data privacy by operating entirely on local infrastructure.
Why it matters: Pythia demonstrates a significant advance in clinical information extraction by enabling effective, privacy-preserving symptom detection without the need for fine-tuning or manual prompt design.
Jul 15, 2026
Research→Official→arXiv AI/ML
MemOps is a new benchmark designed to evaluate the long-term memory capabilities of LLM-based agents by focusing on explicit lifecycle operations such as remembering, forgetting, updating, and reflecting, rather than just final-answer accuracy. The benchmark uses structured traces and operation-level probes to identify specific failure modes, showing that current systems are not uniformly reliable. Notably, session-level retrieval outperforms turn-level retrieval, and long-context models have difficulty reconstructing ordered memory-state trajectories.
Why it matters: MemOps enables more interpretable and targeted evaluation of conversational AI memory systems by diagnosing memory failures at the operation level rather than relying solely on end-task accuracy.
Jul 15, 2026
Research→Official→arXiv AI/ML
Researchers introduce OAT, a method for identifying error steps in large language model (LLM)-based agentic systems by training solely on successful trajectories. OAT uses neural controlled differential equations to model the dynamics of success and assigns anomaly scores to steps in failed trajectories, enabling unsupervised failure attribution. Experiments show OAT is 200–5000× faster than prompting-based baselines and achieves higher F1 scores: +20% in-domain and +7% out-of-distribution.
Why it matters: This approach offers a scalable and efficient way to debug agentic LLM systems without requiring costly failure annotations, potentially improving their reliability.
Jul 15, 2026
Research→Official→arXiv AI/ML
A new preprint introduces Visual Access Sweep, a causal intervention technique to study how Vision-Language Models (VLMs) use image information during Chain-of-Thought (CoT) reasoning. The study finds that VLMs do not require ongoing access to image tokens throughout CoT reasoning; instead, CoT mainly extends language-side computation over previously extracted image-derived hidden states. The research also shows that the effectiveness of CoT is limited by the model's ability to reliably read out perceptual attributes, rather than by its counting ability.
Why it matters: This work challenges common assumptions about CoT in VLMs and suggests that improving perceptual readout, rather than extending visual access, may be key to further performance gains.
Jul 15, 2026