What changed in AI — Page 107

ResearchOfficialarXiv Computers and Society

AI Agent Architecture Strongly Influences Journalism Task Performance, Study Finds

A new preprint systematically compares four AI agent architectures—monolithic, chain-based, multi-agent, and iterative—across 50 journalism tasks using the same language model and tools. The study finds that architecture explains 82% of the variance in processing behavior. Multi-agent collaboration achieved the highest accuracy (84.7%) but required about twice the time of other designs, while the monolithic architecture exhibited a 71.7% source rejection rate, paralleling classic human gatekeeping.

Why it matters: The findings provide evidence-based guidance for newsrooms on selecting AI architectures based on priorities such as speed, accuracy, or auditability.

ResearchOfficialarXiv Computation and Language

Diagnosing and Mitigating Thinking Collapse in On-Policy Self-Distillation

Researchers have identified 'Thinking Collapse,' a failure mode in on-policy self-distillation (OPSD) for large language models, where intermediate reasoning abilities degrade during training. They introduce Adaptive Dual-Perspective OPSD (AD-OPSD), a method that dynamically moderates the self-distillation objective to preserve reasoning capacity. Experiments show that AD-OPSD improves accuracy by up to 4.1% on mathematical benchmarks compared to standard OPSD.

Why it matters: This work addresses a critical limitation in a widely used LLM training technique, potentially leading to more reliable reasoning in complex tasks.

Policy & SafetyOfficialarXiv Cryptography and Security

AHA: Automated Red-Teaming Framework Uncovers Reusable Vulnerabilities in Production LLM Agents

A new preprint introduces AHA, an automated red-teaming system designed to discover and formalize reusable vulnerability knowledge in production LLM agents such as Claude Code and Codex. AHA iteratively proposes vulnerability hypotheses, constructs falsifiers, and builds a Vulnerability Concept Graph (VCG) that links attack surfaces to unsafe agent behaviors. In experiments, the VCG outperformed the strongest frozen discovery baseline by 14.2 percentage points and demonstrated transferability across models and attack scenarios. The VCG serves as an auditable artifact for safety teams to inspect, validate, and patch vulnerabilities.

Why it matters: This work advances scalable and reusable safety testing for production LLM agents, helping safety teams keep pace with evolving threats and models.

ResearchOfficialarXiv Computers and Society

Small Edits, Large Models: How Wikipedia Advocacy Shapes LLM Values

A new study demonstrates that a small group of Wikipedia editors, known as the Pro-Animal Wikipedians (PAW), can significantly influence how large language models (LLMs) discuss animal welfare by making targeted Wikipedia edits. Using advanced attribution methods, researchers found that PAW-edited sections overwhelmingly dominate the most influential documents for animal welfare queries in Llama models, but not for unrelated topics. The study also showed that models fine-tuned on PAW content performed better on animal welfare text, confirming the targeted impact of these edits.

Why it matters: This research provides concrete evidence that small-scale, coordinated editing campaigns on Wikipedia can shape the outputs and values of large language models, raising concerns about the integrity and potential manipulation of training data.

ResearchOfficialarXiv Computer Vision

Benchmark Study Finds YOLO26 Offers No Clear Advantage Over Predecessors for Edge Deployment in Aquaculture

A new benchmark study compares YOLO26 with YOLOv5u, YOLOv8, and YOLO11 for fish mortality detection on edge devices. The results show that all models achieve similar detection accuracy when trained on sufficient data, with mAP50 differing by only about 1 percentage point. However, YOLO26 requires more training images to match the data efficiency of YOLOv8, and while YOLO26n is the fastest on Raspberry Pi 5, YOLOv5mu leads on CPU hardware.

Why it matters: This study demonstrates that new model architectures do not automatically yield better performance for edge AI applications, underscoring the importance of considering data requirements and hardware constraints in model selection.

Policy & SafetyOfficialarXiv Computers and Society

Generative AI Reduced Study Time and Learning Outcomes in Math, Large-Scale Study Finds

A ten-year study analyzing 3.2 million learning interactions found that, following the release of ChatGPT, college students spent 26.9% less time on math problems susceptible to AI assistance, with a 25% decline in retention on proctored assessments. The effect was not observed under proctoring, suggesting the reduction in time was not due to increased efficiency. The authors interpret these findings as evidence of 'cognitive surrender' with implications for education and AI policy.

Why it matters: This study provides some of the first large-scale behavioral evidence that generative AI is changing how students study and what they learn, raising important questions for educational assessment and AI regulation.

Policy & SafetyOfficialarXiv Cryptography and Security

Minionese: Comprehensive Benchmark and Mechanistic Study of Multilingual LLM Safety

Researchers introduce Minionese, a multilingual jailbreak benchmark that spans 18 languages, 4 resource tiers, and 4 perturbation types to evaluate the safety alignment of large language models (LLMs). The study finds that prompts refused in English can elicit harmful responses in non-English and low-resource languages, with each attack type exposing distinct vulnerabilities. Mechanistic analysis reveals that low-resource jailbreaks exploit geometric misalignments in model representations, bypassing refusal mechanisms without disabling them.

Why it matters: This work demonstrates that evaluating LLM safety solely in English is inadequate, emphasizing the need for multilingual and script-aware safety assessments.

ResearchOfficialarXiv Computer Vision

UniPose9D: Universal Category-Agnostic Object Pose Estimation

UniPose9D is a foundation model for 9D object pose estimation that operates without relying on category labels, CAD models, or reference views. It leverages point pairs and introduces a novel RANSAC N-hop Kabsch-Umeyama algorithm to predict rotation, translation, and metric size from RGB-D input or RGB images with predicted depth. The model demonstrates performance that matches or surpasses specialist methods across six datasets and shows strong generalization to unseen objects and real-world scenarios.

Why it matters: This work represents a significant advance in generalizable 3D vision, enabling robust pose estimation for arbitrary objects without category-specific training, which is important for robotics and augmented reality.

ResearchOfficialarXiv Audio and Speech Processing

Speech Language Models Fail to Align with Human Sound Symbolism Perception

A new preprint finds that speech language models (SLMs) do not share the human tendency to map speech sounds to perceptual qualities such as roundness or sharpness. Using genuine speech recordings, the study shows that SLMs' auditory judgments align poorly with human perception and that these models miss key acoustic cues, like spectral tilt, that humans use. The deficit is traced to the models' speech representations rather than their visual processing.

Why it matters: This work highlights a fundamental gap in current speech models, indicating that achieving human-like perceptual alignment will require improved speech representations.

Policy & SafetyOfficialarXiv Cryptography and Security

Banshee Attack Uses Sound to Hijack Drone Visual Tracking Systems

Researchers have introduced Banshee, the first physically realizable attack that uses acoustic injection to induce target switching in UAV visual tracking systems. By exploiting acoustic vulnerabilities in gimbal-camera systems, Banshee causes camera-view drifts that break target associations, achieving a 93.6% success rate in simulation and 95.5% in real-world tests against commercial drones.

Why it matters: This work demonstrates a practical cross-domain vulnerability between acoustics and vision in autonomous systems, emphasizing the need for more robust gimbal designs to prevent such attacks.

ResearchOfficialarXiv Computer Vision

RSLoRA: Training-free Rank Allocation for LoRA via Representational Sensitivity Probing

RSLoRA is a training-free and gradient-free method for allocating ranks in Low-Rank Adaptation (LoRA) by analyzing activation-space geometry. The approach uses representational probing to identify which neural network layers require higher rank capacity, enabling more effective parameter-efficient fine-tuning. According to the preprint, RSLoRA outperforms existing allocators such as AdaLoRA and GoRA on standard benchmarks.

Why it matters: RSLoRA offers a more efficient and representation-aware alternative to existing LoRA rank allocation methods, potentially improving large-scale model adaptation without the need for iterative training or gradient computation.

ResearchOfficialarXiv Computation and Language

LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry

A new preprint investigates the pragmatic reasoning abilities of large language models (LLMs) in multi-party collaborative tasks where participants have only partial information. The study finds that while LLMs can display some pragmatic skills, they often struggle to communicate effectively under epistemic asymmetry and frequently fail to recognize violations of Grice's cooperative principles.

Why it matters: This work reveals key limitations in LLMs' ability to engage in effective, cooperative communication in real-world scenarios where information is not fully shared.

ResearchOfficialarXiv Cryptography and Security

Multi-Agent System Recommends Security Controls with High Coverage and Efficiency

A new preprint proposes a Security Decision Support System that recommends security control sub-families based on minimal user requirements. Using a Multi-Agent Influence Diagram model and no-regret online learning, the system achieves 99% satisfaction coverage while utilizing only about 65% of software-implementable controls, according to validation on curated datasets. The approach aims to balance security coverage with resource efficiency, with results showing rapid computation times.

Why it matters: This framework could enable organizations with limited cybersecurity expertise to make more effective and resource-efficient security decisions.

Policy & SafetyOfficialarXiv Cryptography and Security

Temporary Authority, Permanent Effects: Commit-Time Authorization for LLM Agents

A new preprint introduces the concept of commit-time authorization, a security property ensuring that LLM agents only commit durable effects if the authority evidence remains valid at the moment of commitment. The authors demonstrate that, in a controlled test suite, 207 out of 216 invalidating runs resulted in unauthorized commits after the authorizing path had failed, revealing a significant security gap. To address this, they propose CommitGuard, a fail-closed boundary monitor that blocks stale authorization attempts at commit time.

Why it matters: This work exposes a critical security vulnerability in LLM agents related to the misuse of temporary authority and offers a practical mitigation strategy.

ResearchOfficialarXiv Computers and Society

Multi-Agent Debate Framework Enhances Language Learning Assessment and Progression

A new framework called Learning in Blocks uses heterogeneous multi-agent debate (HeteroMAD) to assess conversational language proficiency with CEFR-aligned rubrics. In benchmarking, HeteroMAD achieved 90.91% recommendation acceptability and demonstrated superior score agreement. An 8-week study with 180 learners showed that integrating rubric-based scoring, targeted recommendations, and mastery-based progression led to better learning outcomes compared to feedback alone.

Why it matters: This work provides a validated approach for using LLM-based multi-agent debate to reliably assess and guide progression in open-ended language learning conversations.

ResearchOfficialarXiv Computers and Society

Helpfulness Post-Training Degrades Compassion Values More Than Coding Post-Training in Llama 3.1 8B

A preprint study on Llama 3.1 8B finds that post-training focused on helpfulness (using SFT and GRPO) significantly degrades animal compassion values compared to coding-focused post-training, as measured by the ANIMA benchmark (SFT: 35.7% vs. 65.2%; GRPO: 18.7% vs. 32.0%). Helpfulness training also reduces general moral reasoning by 25.5 percentage points on English MORU items, but this effect does not transfer to other languages, whereas the compassion effect does. The findings suggest that coding-domain post-training may better preserve values instilled during mid-training without harming general reasoning.

Why it matters: This research highlights that standard helpfulness post-training can unintentionally erode ethical values acquired during pre-training, which has important implications for designing AI training pipelines to maintain value alignment.

ResearchOfficialarXiv Computation and Language

Study: Language Models Struggle to Retain Facts in Weights During Continual Learning

A new preprint finds that language models have difficulty reliably accumulating facts in their weights during continual learning. After twenty sequential writes, facts trained with diverse data retain 46% accuracy, while those trained with bare statements retain only 1%. The study suggests that context, rather than model weights, is the more reliable channel for composing or preserving facts through multiple updates.

Why it matters: This challenges the feasibility of using language model weights for continual knowledge accumulation, with implications for how models are updated and retain information over time.

ResearchOfficialarXiv Cryptography and Security

When Local Monitors Miss Compositional Harm: Diagnosing Distributed Backdoors in Multi-Agent Systems

A new preprint demonstrates that runtime monitors which check each step or message individually can fail to detect distributed backdoors in multi-agent LLM systems, where a harmful payload is split across agents so that each local check passes. The authors formalize an 'observability boundary,' proving that if fragments appear benign in the monitored view, no detector operating on that view can identify the attack. They show that while monitors trained only on benign traffic can recover attack structure (0.874 mean AUROC) and a decoded-view gate can block all tested attacks, even full-trace monitors fail unless they access the representation where the payload is exposed.

Why it matters: This work exposes a fundamental limitation in current safety monitoring for multi-agent AI systems, highlighting that local checks cannot guarantee global safety when harm is distributed across agents.

ResearchOfficialarXiv Computer Vision

DynaFilter: Cloud-driven Dynamic Filtering for Satellite Edge Intelligence

DynaFilter is a dynamic filtering technique that allows satellite edge devices to perform selective region-of-interest inference directly in the compressed domain, eliminating the need for full decompression. The method leverages low-level compression features to identify and transmit only relevant data, reducing the pixel data required for decoding by 1.6x-7.1x for images and achieving up to 92.0% bandwidth savings for video streams compared to state-of-the-art baselines. Additionally, DynaFilter decreases energy consumption by 43.1-88.6% and speeds up inference latency by 1.6x-3.0x on target devices.

Why it matters: This technique enables more efficient and practical remote sensing on satellite edge systems by significantly reducing bandwidth, energy use, and latency.

ResearchOfficialarXiv Computation and Language

MafiaScope: Non-Invasive Belief Probing for LLM Agents in Social Deduction Games

MafiaScope is an open testbed that adapts the social deduction game Mafia to probe the beliefs and Theory of Mind of LLM agents. After each public utterance, agents privately answer structured probe questions, with responses scored against ground truth and visualized as belief trajectories. In a 32-game case study using DeepSeek, the system revealed poor calibration (expected calibration error 0.17) and a tendency for agents to over-predict being suspected. The platform, including engine, viewer, and a large corpus of games, is released under an open license.

Why it matters: This introduces a novel, systematic approach to measuring and visualizing the internal beliefs and reasoning processes of LLM agents during social interactions.