Research→Official→arXiv Software Engineering
Researchers introduce OpsMem, a dual-memory framework that coordinates short-term diagnostic state with long-term operational experience using cross-memory resonance. On a real-world Huawei microservice failure diagnosis dataset, OpsMem outperforms agentic-reasoning and knowledge-augmented baselines, improving diagnosis accuracy metrics by up to 46.88% and 18.39%.
Why it matters: OpsMem demonstrates a significant advance in LLM-based failure diagnosis by effectively integrating short- and long-term memory, leading to notably improved diagnostic performance in complex software systems.
Jul 14, 2026
Research→Official→arXiv Software Engineering
AgentCheck is an open-source web workbench that enables systematic testing of LLM agents using tools via an MCP server. It records tool responses, injects 12 types of faults, and allows developers to re-run agents to evaluate the effectiveness of mitigations. In tests across five agents, the best agent passed 105 out of 120 scenarios, while the weakest passed 77, with most failures involving silent misuse of incorrect tool outputs.
Why it matters: AgentCheck addresses a critical gap in reliability testing by providing a reproducible and controlled environment to evaluate and improve the robustness of tool-using LLM agents before deployment.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new preprint evaluates large language models' (LLMs) ability to generate Unity C# game scenes in a single pass, without iterative repair. Across 10,400 generations, none of the outputs compiled successfully. The study categorizes over 90,000 compiler errors, finding that most failures stem from invented or misused Unity APIs rather than general code structure, highlighting a key limitation in LLMs' domain-specific knowledge.
Why it matters: This work demonstrates a fundamental barrier to using LLMs for domain-specific code generation without iterative feedback, clarifying the gap between LLMs' general knowledge and practical software engineering needs.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Researchers introduced LMVQA, a large language model-based multimodal question-answering system designed for technical meeting videos containing diagram-rich content such as UML diagrams. LMVQA significantly improved answer accuracy over a state-of-the-art baseline, from 31% to 94% on an industrial dataset and from 21% to 88% on a public dataset. The system also reduced average response time and LLM API costs after a one-time video indexing process. Interviews with domain experts highlighted LMVQA's value for locating relevant information and tracing rationale in software engineering meetings.
Why it matters: LMVQA addresses the challenge of efficiently retrieving knowledge from complex, diagram-rich meeting recordings, which is crucial for software engineering teams relying on asynchronous communication.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new study evaluates Centaur, a foundation model trained on data from 160 general psychological experiments, on nine program-comprehension tasks. Centaur's predictions of human responses align more closely with actual human data than those of its base model, Llama 3.1. The model relies less on prior trial information and more on task-specific context, indicating that cognitive patterns learned from general psychology can transfer to complex software engineering tasks.
Why it matters: This research demonstrates that foundation models of human cognition can be leveraged to better predict developer behavior, potentially informing the design of improved tools for code understanding and developer support.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A longitudinal study of 182 repositories finds that while agentic and human code contributions have similar overall maintenance rates, agentic code requires significantly more corrective maintenance and introduces more security weaknesses and dependency vulnerabilities. The study also finds that a 10 percentage-point increase in a project's no-review rate is associated with a 6% increase in agentic maintenance burden.
Why it matters: As AI coding agents become more common, this research shows that merge success is not enough; agentic tools must be designed to produce code that remains secure and maintainable over time.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A large-scale empirical study of 1,993 ML-related Dockerfiles finds that containers average 10.27 GB in size and take about 8.84 minutes to build. The research shows that 44.4% of commits trigger rebuilds, with 71% of rebuild work wasted on redundant computation, and identifies 7 recurring ML-specific Dockerfile refactoring patterns to improve efficiency.
Why it matters: This is the first comprehensive analysis of containerization in ML projects, revealing inefficiencies and offering actionable refactoring patterns to optimize build processes.
Jul 14, 2026
Research→Official→arXiv Software Engineering
AfterVibe is a framework that extracts abstract natural-language specifications from AI-assisted coding sessions by analyzing both the code and the conversation that produced it. The framework validates these specs through a regeneration test, where a separate AI agent re-implements the code from the spec alone, achieving a mean regeneration score of 5.06 out of 6.0 on 72 real-world projects. The specs are shown to be both abstract and strong, outperforming existing human-authored descriptions and supporting iterative refinement.
Why it matters: AfterVibe demonstrates that natural-language specifications can effectively capture developer intent and may serve as a primary review artifact as AI-generated code becomes more prevalent.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new study evaluates large language models (LLMs) for classifying static-analysis alerts as real bugs or false alarms, applying consistency checks and reasoning evaluation to reduce errors. Mid-tier reasoning LLMs achieved at least 98% recall and 94.8% specificity across three benchmark suites. The researchers also used LLM-generated trigger programs to provide independent evidence of real flaws, finding that valid triggers reliably indicated true positives.
Why it matters: This work suggests LLMs, when combined with error mitigation strategies, could significantly reduce the manual effort required to review static-analysis alerts in software security.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new tool for regression verification uses LLM-inferred partial contracts to verify software patches without requiring full codebase re-verification or manually written specifications. The approach achieves soundness by proving behavioral equivalence between function versions and demonstrates, on benchmarks, that partial contracts are nearly as tight as full specifications. The tool reports zero false proofs and can automatically infer contracts from counterexamples, making regression verification more practical and efficient.
Why it matters: This work offers a practical, sound method for automated regression verification, potentially reducing the effort and expertise required to ensure software correctness after updates.
Jul 14, 2026