Research→Official→arXiv Computation and Language
A new preprint introduces the One-Word Census, a minimal and low-cost method to measure answer-choice conformity across 44 language models. The study finds that when prompted to 'pick a word,' 41% of models chose 'serendipity,' and in several categories, a single answer dominated responses. The research reveals that newer flagship models tend to be the most conformist, while persona- and community-tuned models are more divergent. The findings highlight structured variation in conformity across model families and generations.
Why it matters: This work provides a practical tool for benchmarking diversity and conformity in language model outputs, with implications for understanding creativity and bias in AI systems.
Jul 15, 2026
Research→Official→arXiv Computation and Language
KnowAct-GUIClaw is a new framework for GUI automation that addresses limitations in cross-platform support and self-evolution found in previous systems like OpenClaw. The framework introduces a Know-Route-Act-Reflect paradigm, enabling the agent to accumulate user interaction experience and improve execution accuracy over time. In experiments, KnowAct-GUIClaw using the open-source Kimi-2.6 model achieved 64.1% on the MobileWorld benchmark, outperforming both open and closed-source alternatives such as Seed-2.0-Pro and GPT-5.5.
Why it matters: This work represents a notable advance in personal GUI assistants by enabling self-evolving memory and skill transferability across platforms and models, potentially improving automation efficiency and adaptability.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers introduce QDEvo, a framework that integrates Quality-Diversity optimization with large language model (LLM)-driven heuristic search to address mode collapse in automated heuristic design. QDEvo maintains an archive of semantically diverse algorithms using code embeddings and hierarchical self-reflection. Experiments across benchmarks and real-world applications show that QDEvo outperforms state-of-the-art methods in Hypervolume and Inverted Generational Distance metrics.
Why it matters: This work advances automated heuristic design by promoting semantic diversity, potentially enabling more robust and efficient solutions for complex optimization problems.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new study introduces a Bayesian model for intercomprehension—the partial understanding of an unfamiliar but related language—by leveraging a first-language (L1) language model and a noise model to infer mappings from the unfamiliar language (L2) to L1. Human experiments demonstrate that the model's predictions closely match human performance and outperform zero-shot prompting of much larger language models.
Why it matters: This work advances our understanding of cross-language comprehension and provides a computational framework that could inform the development of more flexible multilingual AI systems.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new preprint introduces the Roundtable Context Window Test (RCWT), a protocol designed to measure how coordination content—such as shared state and prior discussion—displaces task-relevant tokens in large language model (LLM) prompts under fixed context budgets. The study finds that as coordination overhead increases, model performance drops sharply once the remaining task-relevant evidence falls below a few hundred tokens. An ablation experiment shows this effect is due to budget displacement, not semantic interference from coordination content.
Why it matters: This work provides a practical measurement tool for understanding and managing context allocation in multi-agent and memory-augmented LLM systems, highlighting a key bottleneck when coordination content consumes limited prompt space.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new study finds that large language models (LLMs) often appear robust to irrelevant context when measured by overall accuracy, but this masks significant instability on individual examples. Even meaningless pseudo-words can cause prediction changes for a small subset of inputs, sometimes degrading and sometimes improving performance. The specific examples affected are mostly unique to each model, and the degree of instability depends on factors like context type, length, test-time compute, and model development stage.
Why it matters: This research highlights that aggregate accuracy metrics can conceal important reliability risks in LLMs, underscoring the need for per-example evaluation for safer deployment.
Jul 15, 2026
Research→Official→arXiv Computation and Language
PalmClaw is an open-source agent framework that operates natively on mobile phones, managing sessions, memory, skills, tools, and the agent loop directly on the device. Unlike prior approaches that rely on GUI-based actions, PalmClaw exposes device capabilities as explicit tools with structured arguments and results, enabling more direct and controlled access. Experiments demonstrate an 11.5% relative improvement in task success and a 94.9% reduction in completion time compared to the strongest baseline.
Why it matters: PalmClaw represents a significant advance by enabling LLM agents to interact with mobile device capabilities directly and efficiently, overcoming limitations of GUI-based methods.
Jul 15, 2026
Research→Official→arXiv Computation and Language
CityBehavEx is an interactive urban simulation platform that integrates large language models (LLMs) with traditional human mobility models to efficiently simulate city-scale populations. The system can run simulations of 100,000 agents over 75 days in under one hour on a single consumer GPU, and supports empirical validation by comparing generated mobility patterns to real-world spatial, temporal, and semantic distributions. CityBehavEx also provides tools for inspecting agent behavior, debugging, and validating routines against real-world data, addressing scalability and validation challenges in prior LLM-based simulators.
Why it matters: This work offers a scalable and empirically validated approach to LLM-driven urban simulation, potentially advancing applications in urban planning and policy analysis.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new study finds that LLM judges tend to be overly generous when evaluating open-ended responses without a reference answer, often over-crediting incorrect answers. The research shows that adding a reference answer to the prompt can flip correct/incorrect decisions by up to 85% in some cases, and these changes generally align more closely with human judgments.
Why it matters: This research highlights a critical calibration issue in using LLM judges for no-reference evaluation, which is increasingly common in practice.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new preprint introduces ThReadMed-QA, a dataset of 2,437 multi-turn patient-physician threads, to evaluate large language models (LLMs) on their ability to detect and correct medical misconceptions over several conversational turns. The study finds that even advanced models like GPT-5 and Claude-Haiku drop from about 85% accuracy on initial questions to around 50% after two follow-ups, with error propagation identified as a major cause of this decline. The results highlight that LLMs' ability to maintain accurate corrections diminishes over the course of a conversation.
Why it matters: This work exposes a significant safety risk in using LLMs for medical advice, as their corrections of misconceptions degrade in multi-turn interactions, potentially leading to unsafe outcomes.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers introduce LakeQuest, a human-validated benchmark containing 9,846 question-answer pairs across three domains: AI/ML metadata, retail banking, and biomedical drug information. The benchmark is designed to evaluate end-to-end retrieve-and-synthesize pipelines over heterogeneous, weakly structured data lakes. Baseline evaluations show that even with high-quality retrieval, current QA systems often fail at complex reasoning tasks such as relation chaining, policy grounding, and joint tabular question answering.
Why it matters: LakeQuest reveals critical weaknesses in current QA systems when applied to real-world, weakly structured data lakes, emphasizing the need for more robust discovery and synthesis methods.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers introduce a scalable pipeline for generating high-quality evaluation rubrics for financial report assessment without requiring human experts in the final evaluation loop. Using 104 real-world queries and 14,450 candidate rubrics, they demonstrate that LLM-based evaluation achieves 98.67% label-level agreement with human experts on jointly unanimous items. The process yields a final set of 2,600 consensus-derived gold rubrics, enabling differentiated rankings across 10 deep research systems.
Why it matters: This work enables large-scale, automated evaluation of AI-generated financial reports, reducing reliance on human experts and facilitating more efficient system comparison and improvement.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers improved the Huth et al. fMRI encoding pipeline, achieving an 11% METEOR gain by expanding voxel selection and updating the proposal model. However, when using a new method that maps fMRI signals to a frozen Llama 3.2 language model, they found that decoding performance was almost entirely due to the language model's prior, as blind controls with zeroed fMRI input produced nearly identical results. This indicates that apparent decoding success may not reflect true neural decoding.
Why it matters: The study demonstrates that high-capacity language models can mask failures in fMRI decoding, emphasizing the need for rigorous blind-control evaluations in neural decoding research.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new preprint introduces Ring-Zero, a training pipeline that successfully scales reinforcement learning with verifiable rewards (zero RL) to a 1-trillion-parameter model. The authors report that scaling leads to significant improvements in sample efficiency and performance, and that the model exhibits emergent advanced reasoning behaviors such as self-verification and parallel reasoning. On seven mathematical benchmarks, the model achieves competitive results and demonstrates advantages in producing structured and concise reasoning traces.
Why it matters: This work provides evidence that scaling zero RL to trillion-parameter models can yield emergent reasoning capabilities, offering new insights into the development of large-scale reasoning systems.
Jul 15, 2026
Research→Official→arXiv Computation and Language
EcoSpec is a cost-aware speculative decoding framework designed to improve inference efficiency in large-scale Mixture-of-Experts (MoE) language models. By incorporating predicted expert activation costs into draft token selection, EcoSpec encourages reuse of already-loaded experts during speculative decoding. Evaluations on models such as DeepSeek-V3.1 (671B), Qwen3-235B-A22B, and GPT-OSS-120B show that EcoSpec reduces expert activation footprints and achieves up to 1.62× speedup in end-to-end decoding, without modifying verification rules.
Why it matters: This work offers a practical advance for accelerating inference in large MoE language models by optimizing draft selection for expert reuse, directly improving decoding speed and efficiency.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A preprint study used the Iowa Gambling Task to test whether induced emotions bias large language model (LLM) decision-making. The researchers found that, unlike humans, LLMs do not show significant average bias from induced emotion. However, anger specifically made LLMs less sensitive to penalties and reduced their early-stage exploration, leading to more rigid choices. The study also validated a new paradigm for studying affective influences on LLMs.
Why it matters: Understanding how emotional context affects LLM decision-making is important for ensuring the safety and reliability of autonomous AI agents in real-world applications.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A hybrid trading agent, Fin-Analyst, combining eight LLM specialists with rule-based signals, achieved first place on the FinMMEval 2026 Task 3 leaderboard for Tesla (TSLA), delivering a +13.51% return and a Sharpe ratio of 4.10. The agent uses LLMs to analyze diverse financial data sources, aggregated by a Meta-Agent, while a rule-based approach was used for Bitcoin. The study also found that memoryless agents tend to repeat errors and that fixed-threshold rules underperform LLM pipelines in sideways markets.
Why it matters: This work demonstrates a significant advance in the practical deployment of LLM-based trading agents, showing strong real-world performance and offering insights for future agent design.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers introduce Malleable Prompting, a technique that transforms natural language preference expressions into interactive GUI widgets such as sliders and toggles for controlling large language model (LLM) outputs. The method includes a new decoding algorithm that adjusts token probabilities based on widget settings. A user study demonstrates that this approach enables users to achieve target preferences more precisely and perceive greater controllability and transparency compared to standard natural language prompting.
Why it matters: This work presents a novel, interactive approach that could make controlling LLM outputs more intuitive and effective for users.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers have introduced ESFP, a behavioral benchmark designed to assess whether large language models (LLMs) can shift their epistemic register when prompted about expert beliefs versus their own beliefs. In tests of eight frontier models, results show that epistemic flexibility is largely independent of general model capability, with a 27B open-weight model performing on par with leading proprietary systems. The study also finds that stance content density is a stronger indicator of flexibility than surface-level lexical markers.
Why it matters: This benchmark fills a key gap in evaluating conversational AI by measuring models' ability to distinguish between self-attributed and externally attributed stances, which is important for trustworthy interactions.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new study introduces a multi-feature fusion framework that integrates static lexical (W2V) and dynamic contextual (GPT) representations using an interactive gating mechanism for semantic reconstruction from non-invasive neural recordings. The framework systematically compares linear concatenation and non-linear cross-attention fusion, finding that the cross-attention method achieves state-of-the-art performance, surpassing single-representation approaches. This demonstrates improved neural language decoding by simulating the brain's integration of contextual and lexical features.
Why it matters: The work advances non-invasive brain-to-text decoding by showing that combining multiple semantic features yields significantly better results than previous single-feature methods.
Jul 15, 2026