Research→Official→arXiv Computation and Language
A new preprint evaluates whether translating non-English data into English and fine-tuning English BERT models can match or outperform native-language BERT models across six NLP tasks. The study finds that this translation-based approach is comparable or superior in 53.3% of cases, especially for syntactic tasks and languages typologically close to English, but is less effective for token-level or culturally nuanced tasks.
Why it matters: This work demonstrates a practical, resource-efficient strategy for extending NLP capabilities to low-resource languages without the need for large native-language models.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers have identified a general 'countdown subcircuit' in Llama-3.1-70B-Instruct that compares the current position to a goal length, allowing the model to estimate remaining tokens. This subcircuit uses an identical motif previously found in a frontier LLM on a different task, indicating shared mechanisms across models. Unsupervised probing revealed that the subcircuit is employed in various natural language tasks, including those where the goal length must be inferred from context.
Why it matters: This finding advances mechanistic interpretability by revealing a shared neural mechanism for token counting across tasks and models, potentially improving our understanding and control of LLM behavior.
Jul 15, 2026
Research→Official→arXiv Cryptography and Security
Researchers have developed MindReader, a tool that leverages large language models (LLMs) to help users generate password replacements that are both secure and memorable. MindReader analyzes the semantic meaning of original password components and suggests new, semantically related but syntactically different replacements. In a user study, passwords created with MindReader were more resistant to guessing attacks than both original and conventionally replaced passwords, while maintaining similar memorability.
Why it matters: This work offers a practical LLM-based approach to improving password security without sacrificing usability, addressing a persistent vulnerability in password management.
Jul 15, 2026
Policy Safety→Official→arXiv Cryptography and Security
A new preprint demonstrates that integrating Post-Quantum Cryptography (PQC) into TLS 1.3 can dramatically increase server vulnerability to handshake exhaustion DDoS attacks, with server CPU exhaustion periods prolonged by up to 88 times. The study also finds that leading deep learning-based intrusion detection systems (IDS) experience severe performance drops under PQC traffic, with one system's recall falling to about 50% and another's detection accuracy approaching random chance.
Why it matters: As PQC adoption accelerates, these findings highlight urgent new security risks, showing that quantum-safe cryptography may inadvertently create exploitable weaknesses that current defenses cannot address.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new method formulates evidence selection in retrieval-augmented question answering (RAG) as a Quadratic Unconstrained Binary Optimization (QUBO) problem. This approach balances relevance, coverage, and redundancy, and achieves competitive performance with LLM-based selectors on the HotpotQA benchmark, while enabling the use of Ising/QUBO solvers for context selection.
Why it matters: The work demonstrates that multi-hop evidence selection can be effectively handled by discrete optimization solvers, potentially reducing reliance on LLMs for intermediate steps and improving scalability and cost-efficiency in RAG pipelines.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers present CARE-PPO, a reinforcement learning framework that adapts the actor-critic PPO method to enable large language models (LLMs) to jointly produce accurate numerical predictions and well-calibrated confidence estimates. By repurposing the critic network as a confidence estimator during inference, CARE-PPO demonstrates improved uncertainty calibration compared to logit-based and verbalized baselines on real-world healthcare and finance tasks. The approach also shows robustness to out-of-distribution data and reduces overfitting compared to supervised methods.
Why it matters: This work advances the reliability of LLMs in high-stakes domains by improving both prediction accuracy and confidence calibration, addressing a key challenge for trustworthy AI deployment.
Jul 15, 2026
Research→Official→arXiv Cryptography and Security
Researchers present a framework that combines metamorphic testing and association rule mining to systematically detect and analyze security vulnerabilities in code generated by large language models (LLMs). Evaluating 3,700 code snippets from five open-source models, they found that 68.8% violated at least one security property, with frequent co-occurrence of vulnerabilities such as XSS, weak cryptography, and hard-coded credentials. The study also identifies prompt-level risk factors and structured patterns in how vulnerabilities cluster together.
Why it matters: This work demonstrates that security flaws in LLM-generated code are often interconnected and influenced by prompt context, highlighting the need for cluster-aware verification and improved safeguards in AI-assisted programming.
Jul 15, 2026
Policy Safety→Official→arXiv Cryptography and Security
Antiproof is a vulnerability discovery system that combines neuro-symbolic detector synthesis with proof-of-exploitability oracles to achieve high-recall vulnerability detection and automatic validation. In evaluations, it detected 64 of 66 vulnerabilities in benchmarks, improving recall by over 60 percentage points compared to baselines, and uncovered several hundred previously unknown vulnerabilities in widely deployed systems. The system has received 12 CVE assignments, including remote code execution vulnerabilities in Ray, SGLang, vLLM, and LiteLLM, which could allow attackers to compromise LLM training and inference systems.
Why it matters: This work demonstrates a scalable and effective approach to discovering and validating zero-day vulnerabilities in critical AI infrastructure, with immediate security implications for widely used LLM deployment tools.
Jul 15, 2026
Research→Official→arXiv Cryptography and Security
A new preprint introduces Representation-Confusion Attacks in Reverse Engineering (RARE), where attacker-controlled binaries can manipulate LLM-assisted reverse engineering systems by making extracted data appear as authoritative instructions or independent evidence. The authors present RARE-Guard, a defense mechanism that applies authorization and provenance controls to prevent unsafe actions and false claims. In evaluations, RARE-Guard successfully blocked all unsafe proposals and false claims while preserving legitimate analyst requests and supported claims.
Why it matters: This work reveals a significant security vulnerability in LLM-assisted reverse engineering pipelines and demonstrates a practical defense that could improve the safety and reliability of automated software analysis tools.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers evaluated agentic large language model (LLM) systems for generating breast cancer treatment recommendations using 72 real clinical cases and 1,147 case-specific rubrics. The best-performing system, Claude Opus 4.8 with a D&C+SA pipeline, achieved a global score of 0.594, but oncologist-led error analysis found persistent clinically relevant failures, including incorrect or missing recommendations, flawed justifications, citation errors, outdated claims, and overconfidence.
Why it matters: The study demonstrates that while agentic LLMs can generate clinically relevant recommendations, they are not yet reliable enough for unsupervised clinical use in oncology.
Jul 15, 2026
Research→Official→arXiv AI/ML
A new evaluation framework called Elenchos assesses large language models' (LLMs) ability to perform abductive reasoning by having them infer hidden mutations in formal systems. The study finds that both frontier and mid-tier LLMs can often detect that a system has changed but struggle to accurately identify the specific underlying mutations. Performance drops further when multiple interacting mutations are present, and increasing inference-time reasoning yields only modest gains.
Why it matters: This work exposes a key limitation in LLMs' reasoning abilities, highlighting a gap between detecting anomalies and understanding their causes, which is important for applications requiring reliable causal inference.
Jul 15, 2026
Research→Official→arXiv AI/ML
A controlled study of Group Relative Policy Optimization (GRPO) on 4B-8B parameter language and vision-language web agents found that no configuration improved upon a strong supervised baseline. Moderate to high learning rates led to credible performance degradation, particularly on text-based tasks. The study attributes this failure to learning-rate-gated degradation and collapse regimes, with effects that are dependent on model scale.
Why it matters: This work challenges the assumption that reinforcement learning with verifiable rewards reliably improves small agents, identifying specific failure modes tied to learning rate and model scale.
Jul 15, 2026
Research→Official→arXiv AI/ML
A new preprint introduces a framework for co-evolving evaluation metrics alongside skills in self-improving large language model (LLM) agents, addressing the common but often unexamined assumption that reliable evaluation metrics are already available. The proposed Double Ratchet system demonstrates that co-evolved metrics can retain 88–110% of the performance improvement ('lift') achieved by ground-truth-driven skill loops across tasks such as code generation, text-to-SQL, and report generation. The approach incorporates safety mechanisms like anchor discipline and external audits to mitigate metric gaming and ensure transparency.
Why it matters: This work offers a practical and auditable method for evolving evaluation metrics in autonomous AI systems, potentially making self-improving agents more robust and trustworthy in real-world applications where ground-truth metrics are unavailable.
Jul 15, 2026
Research→Official→arXiv AI/ML
Researchers introduced Pythia, a multi-agent system that autonomously generates and optimizes prompts for extracting clinical symptoms from notes, without manual prompt engineering or model fine-tuning. Using a locally hosted open-weights language model, Pythia achieved a mean sensitivity of 0.76 and specificity of 0.95 across 72 signs and symptoms from 400 clinical notes, outperforming a curated lexicon in specificity and matching or exceeding it on both metrics for many concepts. The system preserves data privacy by operating entirely on local infrastructure.
Why it matters: Pythia demonstrates a significant advance in clinical information extraction by enabling effective, privacy-preserving symptom detection without the need for fine-tuning or manual prompt design.
Jul 15, 2026
Research→Official→arXiv AI/ML
MemOps is a new benchmark designed to evaluate the long-term memory capabilities of LLM-based agents by focusing on explicit lifecycle operations such as remembering, forgetting, updating, and reflecting, rather than just final-answer accuracy. The benchmark uses structured traces and operation-level probes to identify specific failure modes, showing that current systems are not uniformly reliable. Notably, session-level retrieval outperforms turn-level retrieval, and long-context models have difficulty reconstructing ordered memory-state trajectories.
Why it matters: MemOps enables more interpretable and targeted evaluation of conversational AI memory systems by diagnosing memory failures at the operation level rather than relying solely on end-task accuracy.
Jul 15, 2026
Research→Official→arXiv AI/ML
Researchers introduce OAT, a method for identifying error steps in large language model (LLM)-based agentic systems by training solely on successful trajectories. OAT uses neural controlled differential equations to model the dynamics of success and assigns anomaly scores to steps in failed trajectories, enabling unsupervised failure attribution. Experiments show OAT is 200–5000× faster than prompting-based baselines and achieves higher F1 scores: +20% in-domain and +7% out-of-distribution.
Why it matters: This approach offers a scalable and efficient way to debug agentic LLM systems without requiring costly failure annotations, potentially improving their reliability.
Jul 15, 2026
Research→Official→arXiv Computation and Language
A new preprint reports that state-of-the-art large language models (LLMs) perform poorly on Korean-Braille translation tasks, producing unstable outputs that often disagree with human judgments. The study finds that these failures stem from missing Braille-aware tokenization and weak alignment between Korean and Braille patterns. In contrast, a small T5-small model, when fine-tuned on the task, achieves large and stable improvements over LLM baselines. The results highlight a systematic limitation of current LLMs in handling accessibility-critical modalities.
Why it matters: The study exposes a significant gap in LLM capabilities for accessibility, indicating that current models are not reliable for Braille translation without specialized adaptation.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers demonstrate that scaling point-in-time language models—trained only on data available up to each calendar date—can substantially narrow the performance gap with models trained on unrestricted internet data. Using up to 4 billion parameters and 1 trillion temporally filtered tokens, their monthly checkpoints from 2013-2024 approach the performance of leading open-weight models like Gemma-3-4B and LLaMA-7B on reasoning and language understanding benchmarks, though some gaps remain. The team also provides a reproducible pipeline for dataset construction, training, and evaluation.
Why it matters: This work enables more valid backtesting and causal inference in finance and social sciences by eliminating future data leakage in language models.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers have introduced CANDI-QA, a new dataset designed to evaluate large language models (LLMs) on context-sensitive and user-aligned question answering in specialized fields such as medical diagnostics and financial advisory. The dataset includes both factual and multi-hop reasoning questions, and initial tests show that current LLMs face significant challenges without improved contextual or symbolic reasoning capabilities. CANDI-QA also provides a neuro-symbolic baseline model, MTSS-Net, to benchmark progress.
Why it matters: CANDI-QA exposes critical limitations in current LLMs for high-stakes, specialized domains, guiding future research toward more reliable and context-aware AI systems.
Jul 15, 2026
Research→Official→arXiv Computation and Language
Researchers introduce G-SHARE, a framework that translates the CNNP nine-step human-factor event diagnosis guideline into a multi-stage pipeline for analyzing events in nuclear power plants. The system integrates evidence extraction, stepwise diagnostic reasoning, and post-hoc consistency repair, enabling explicit use of report evidence and logical validation of outputs. In evaluations on real-world event reports, G-SHARE substantially outperforms one-shot prompting and traditional machine learning baselines, with structured reasoning and consistency enforcement shown to be critical for robust diagnosis.
Why it matters: This work demonstrates a practical method for converting expert diagnostic guidelines into auditable, structured reasoning workflows, potentially improving reliability in safety-critical industries.
Jul 15, 2026