Text and language model news — Page 51

Language models and text-based AI systems, including reasoning, generation, and understanding of written language.

ResearchOfficialarXiv Computation and Language

EcoSpec: Cost-Aware Speculative Decoding for Mixture-of-Experts Models

EcoSpec is a cost-aware speculative decoding framework designed to improve inference efficiency in large-scale Mixture-of-Experts (MoE) language models. By incorporating predicted expert activation costs into draft token selection, EcoSpec encourages reuse of already-loaded experts during speculative decoding. Evaluations on models such as DeepSeek-V3.1 (671B), Qwen3-235B-A22B, and GPT-OSS-120B show that EcoSpec reduces expert activation footprints and achieves up to 1.62× speedup in end-to-end decoding, without modifying verification rules.

Why it matters: This work offers a practical advance for accelerating inference in large MoE language models by optimizing draft selection for expert reuse, directly improving decoding speed and efficiency.

ResearchOfficialarXiv Computation and Language

Induced Emotion Has Subtle, Conditioned Effects on LLM Decision-Making in Sequential Tasks

A preprint study used the Iowa Gambling Task to test whether induced emotions bias large language model (LLM) decision-making. The researchers found that, unlike humans, LLMs do not show significant average bias from induced emotion. However, anger specifically made LLMs less sensitive to penalties and reduced their early-stage exploration, leading to more rigid choices. The study also validated a new paradigm for studying affective influences on LLMs.

Why it matters: Understanding how emotional context affects LLM decision-making is important for ensuring the safety and reliability of autonomous AI agents in real-world applications.

ResearchOfficialarXiv Computation and Language

Hybrid LLM and Rule-Based Trading Agent Tops FinMMEval 2026 Task 3 Leaderboard

A hybrid trading agent, Fin-Analyst, combining eight LLM specialists with rule-based signals, achieved first place on the FinMMEval 2026 Task 3 leaderboard for Tesla (TSLA), delivering a +13.51% return and a Sharpe ratio of 4.10. The agent uses LLMs to analyze diverse financial data sources, aggregated by a Meta-Agent, while a rule-based approach was used for Bitcoin. The study also found that memoryless agents tend to repeat errors and that fixed-threshold rules underperform LLM pipelines in sideways markets.

Why it matters: This work demonstrates a significant advance in the practical deployment of LLM-based trading agents, showing strong real-world performance and offering insights for future agent design.

ResearchOfficialarXiv Cryptography and Security

Study Finds Majority of x402 AI Agent Payments Are Fictitious or Internal

A population-scale analysis of the x402 protocol for AI agent payments on the Base blockchain reveals that, over 280 days, 21.20% of 136.7 million settlements are fictitious and 63.78% are internal to linked clusters. The study finds that genuinely independent payments are much lower, ranging between $187,861 and $20.3 million, indicating that settlement counts primarily reflect manufacturability rather than real adoption.

Why it matters: This research challenges claims of a robust AI agent economy by demonstrating that most on-chain payments can be artificially generated, undermining settlement count as a metric for genuine autonomous economic activity.

ResearchOfficialarXiv Cryptography and Security

Study: 38.9% of AI-Generated Pull Requests Contain Security Smells

A large-scale empirical study of 4,022 pull requests from the AIDev dataset found that 38.9% of agent-generated PRs contain at least one security smell, with supply chain integrity issues accounting for 82.3% of all detected smells. Hard-coded credentials made up 99.6% of critical-severity issues, and 81.1% of these credentials went undetected before integration. The study also found that human collaborators introduced 67.6% of genuine leaked secrets in agent-assisted workflows.

Why it matters: This research reveals that autonomous coding agents introduce significant security risks that current review processes often fail to catch, highlighting the urgent need for improved security guardrails in human-AI collaboration.

ResearchOfficialarXiv Computation and Language

Malleable Prompting: Turning Natural Language Preferences into Interactive Widgets for LLM Control

Researchers introduce Malleable Prompting, a technique that transforms natural language preference expressions into interactive GUI widgets such as sliders and toggles for controlling large language model (LLM) outputs. The method includes a new decoding algorithm that adjusts token probabilities based on widget settings. A user study demonstrates that this approach enables users to achieve target preferences more precisely and perceive greater controllability and transparency compared to standard natural language prompting.

Why it matters: This work presents a novel, interactive approach that could make controlling LLM outputs more intuitive and effective for users.

ResearchOfficialarXiv Computation and Language

New ESFP Benchmark Measures Epistemic Stance Flexibility in LLMs

Researchers have introduced ESFP, a behavioral benchmark designed to assess whether large language models (LLMs) can shift their epistemic register when prompted about expert beliefs versus their own beliefs. In tests of eight frontier models, results show that epistemic flexibility is largely independent of general model capability, with a 27B open-weight model performing on par with leading proprietary systems. The study also finds that stance content density is a stronger indicator of flexibility than surface-level lexical markers.

Why it matters: This benchmark fills a key gap in evaluating conversational AI by measuring models' ability to distinguish between self-attributed and externally attributed stances, which is important for trustworthy interactions.

Policy & SafetyOfficialarXiv Cryptography and Security

PVDetector: Detecting Prompt Injection Attacks on Purpose-Specific LLM Agents via Policy-Violation Concept Analysis

Researchers introduce PVDetector, a training-free framework for detecting prompt injection attacks on purpose-specific large language model (LLM) agents. By analyzing hidden-state alignment with policy-violation concepts, PVDetector identifies attacks with less than 1% false negative rate and minimal computational overhead, outperforming existing input-output pattern-based detectors.

Why it matters: As LLMs are increasingly used for specialized tasks with unique restrictions, PVDetector provides an efficient and effective defense against prompt injection attacks by leveraging the model's internal representations of policy violations.

ResearchOfficialarXiv Cryptography and Security

Open-Source Intelligence Distinguishes Human and LLM Code, Reveals Security Pattern Differences

A new preprint presents a reproducible, open-source pipeline that distinguishes code written by humans from that generated by large language models (LLMs) with 93% accuracy, using samples from 31 security-sensitive programming tasks across four languages. The study finds systematic differences in security patterns between human and LLM-generated code, and shows that LLMs can repair vulnerabilities in code 77% of the time, though repairs are often only partial fixes.

Why it matters: This work advances automated code provenance attribution and highlights important security differences between human and AI-generated code, informing software supply chain security and AI-assisted development practices.

ResearchOfficialarXiv Computation and Language

Multi-Feature Fusion Framework Sets New Benchmark for Semantic Reconstruction from Non-Invasive Brain Recordings

A new study introduces a multi-feature fusion framework that integrates static lexical (W2V) and dynamic contextual (GPT) representations using an interactive gating mechanism for semantic reconstruction from non-invasive neural recordings. The framework systematically compares linear concatenation and non-linear cross-attention fusion, finding that the cross-attention method achieves state-of-the-art performance, surpassing single-representation approaches. This demonstrates improved neural language decoding by simulating the brain's integration of contextual and lexical features.

Why it matters: The work advances non-invasive brain-to-text decoding by showing that combining multiple semantic features yields significantly better results than previous single-feature methods.

ResearchOfficialarXiv Computation and Language

Policy-Conditioned Constrained Decoding for Column-Level Access Control in Text-to-SQL

Researchers introduce PCC-SQL, a method that enforces column-use policies during text-to-SQL decoding by applying per-token logits masking, which deterministically prevents policy violations. The approach achieves a 0% leakage rate and up to 88.7% coverage on the Spider-CU benchmark, with minimal increase in token usage compared to direct prompting. The method is evaluated across three benchmarks and three open-source models, and also assesses semantic alignment with execution accuracy.

Why it matters: This work provides a deterministic solution to enforcing column-level access control in text-to-SQL systems, addressing a key security concern in real-world deployments.

ResearchOfficialarXiv Cryptography and Security

JADR Protocol Measures Internal Danger Recognition in LLMs Without External Judges

Researchers introduce JADR (Jacobian Assessment of Danger Recognition), a protocol that evaluates a language model's internal representation of danger by analyzing Jacobian space activations before any response is generated. The method operates entirely locally, does not require external judge models, and enables comparison of models and quantization levels using a SafetyAUC metric with statistical significance. Applied to six models, including Qwen3 variants and Gemma 2 9B, JADR distinguishes between strong and weak internal safety mechanisms and reveals quantization effects.

Why it matters: This approach provides a novel, judge-free method for probing LLM safety by examining internal model activations, potentially uncovering hidden vulnerabilities in safety mechanisms.

ResearchOfficialarXiv Cryptography and Security

VanillaBench Reveals Hidden Accuracy Cost of Adversarial Robustness

A new benchmark, VanillaBench, systematically quantifies the accuracy cost of adversarial robustness by comparing 186 robust models against vanilla baselines. The study finds that the mean clean accuracy gap ranges from -7.7 to -29.5 percentage points, with even the best robust models trailing their vanilla counterparts by 4.0-21.0 points. The authors recommend that future robustness evaluations should routinely report vanilla-referenced accuracy gaps.

Why it matters: This benchmark makes explicit the substantial accuracy trade-off of adversarial robustness, providing critical information for practitioners and decision-makers that is often missing from individual papers.

ResearchOfficialarXiv Computation and Language

Knowledgeless Language Models: Suppressing Parametric Recall for Evidence-Grounded Language Modeling

Researchers introduce Knowledge-Less Language Models (KLLMs), which are pretrained on corpora with anonymized named entities to reduce the model's reliance on memorized factual knowledge. KLLMs demonstrate reduced closed-book factual recall but outperform standard models on contextual question answering, fact verification, and hallucination detection, especially in retrieval-grounded settings with imperfect evidence, achieving up to 20–25% relative gains. The models also show improved calibration and more reliable abstention behavior, indicating a shift toward evidence-grounded reasoning.

Why it matters: This work shows that controlling knowledge acquisition during pretraining can produce language models that are more robust and reliable in evidence-grounded tasks, potentially improving real-world AI applications.

ResearchOfficialarXiv Computation and Language

Translation as a Computationally Efficient Bridge: Feasibility of English BERT for Low-Resource Languages

A new preprint evaluates whether translating non-English data into English and fine-tuning English BERT models can match or outperform native-language BERT models across six NLP tasks. The study finds that this translation-based approach is comparable or superior in 53.3% of cases, especially for syntactic tasks and languages typologically close to English, but is less effective for token-level or culturally nuanced tasks.

Why it matters: This work demonstrates a practical, resource-efficient strategy for extending NLP capabilities to low-resource languages without the need for large native-language models.

ResearchOfficialarXiv Computation and Language

Shared 'Countdown Subcircuit' Enables LLMs to Track Remaining Tokens Across Diverse Tasks

Researchers have identified a general 'countdown subcircuit' in Llama-3.1-70B-Instruct that compares the current position to a goal length, allowing the model to estimate remaining tokens. This subcircuit uses an identical motif previously found in a frontier LLM on a different task, indicating shared mechanisms across models. Unsupervised probing revealed that the subcircuit is employed in various natural language tasks, including those where the goal length must be inferred from context.

Why it matters: This finding advances mechanistic interpretability by revealing a shared neural mechanism for token counting across tasks and models, potentially improving our understanding and control of LLM behavior.

ResearchOfficialarXiv Cryptography and Security

MindReader: LLM-Powered Tool Suggests Secure, Memorable Password Replacements

Researchers have developed MindReader, a tool that leverages large language models (LLMs) to help users generate password replacements that are both secure and memorable. MindReader analyzes the semantic meaning of original password components and suggests new, semantically related but syntactically different replacements. In a user study, passwords created with MindReader were more resistant to guessing attacks than both original and conventionally replaced passwords, while maintaining similar memorability.

Why it matters: This work offers a practical LLM-based approach to improving password security without sacrificing usability, addressing a persistent vulnerability in password management.

Policy & SafetyOfficialarXiv Cryptography and Security

PQC in TLS Amplifies DDoS Attacks and Blinds Intrusion Detection Systems

A new preprint demonstrates that integrating Post-Quantum Cryptography (PQC) into TLS 1.3 can dramatically increase server vulnerability to handshake exhaustion DDoS attacks, with server CPU exhaustion periods prolonged by up to 88 times. The study also finds that leading deep learning-based intrusion detection systems (IDS) experience severe performance drops under PQC traffic, with one system's recall falling to about 50% and another's detection accuracy approaching random chance.

Why it matters: As PQC adoption accelerates, these findings highlight urgent new security risks, showing that quantum-safe cryptography may inadvertently create exploitable weaknesses that current defenses cannot address.

ResearchOfficialarXiv Computation and Language

QUBO-Optimized Evidence Selection for Retrieval-Augmented Question Answering with Unconventional Solvers

A new method formulates evidence selection in retrieval-augmented question answering (RAG) as a Quadratic Unconstrained Binary Optimization (QUBO) problem. This approach balances relevance, coverage, and redundancy, and achieves competitive performance with LLM-based selectors on the HotpotQA benchmark, while enabling the use of Ising/QUBO solvers for context selection.

Why it matters: The work demonstrates that multi-hop evidence selection can be effectively handled by discrete optimization solvers, potentially reducing reliance on LLMs for intermediate steps and improving scalability and cost-efficiency in RAG pipelines.

ResearchOfficialarXiv Computation and Language

CARE-PPO: RL Framework for LLM Quantitative Prediction with Confidence Estimation

Researchers present CARE-PPO, a reinforcement learning framework that adapts the actor-critic PPO method to enable large language models (LLMs) to jointly produce accurate numerical predictions and well-calibrated confidence estimates. By repurposing the critic network as a confidence estimator during inference, CARE-PPO demonstrates improved uncertainty calibration compared to logit-based and verbalized baselines on real-world healthcare and finance tasks. The approach also shows robustness to out-of-distribution data and reduces overfitting compared to supervised methods.

Why it matters: This work advances the reliability of LLMs in high-stakes domains by improving both prediction accuracy and confidence calibration, addressing a key challenge for trustworthy AI deployment.