Research→Official→arXiv Software Engineering
A new method called ROBIN introduces white-box, head-level fairness debugging for transformer models by ranking attention heads based on their sensitivity to fairness probes and removing a small bias subspace from selected head outputs. In a four-model pilot study, ROBIN reduced the WinoBias gap while preserving language-modeling quality better than whole-head zeroing. The results indicate that both the selection of attention heads and the method of modification are important for effective bias repair.
Why it matters: This work demonstrates a targeted inference-time approach for mitigating bias in transformer models, offering a more precise alternative to retraining or coarse interventions.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A recent preprint demonstrates that providing feedback as line-anchored comments, using the FileMark VSCodium extension, can reduce the number of generated tokens by 22% to 58% compared to holistic prompts in AI code editing tasks. The study found that this approach also improves code correctness, with gains of 2 to 7 points for local models. The benefits are especially pronounced for longer files and for models with more room for improvement.
Why it matters: This work introduces a practical technique that can lower the cost and improve the accuracy of AI-assisted code editing, potentially enhancing developer workflows and model efficiency.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A new preprint introduces 'use-case-oriented regeneration,' a software sourcing paradigm that uses generative AI to synthesize only the specific dependency functionality required by a project, rather than relying on entire external libraries. In an evaluation across 180 repository-dependency pairs, the approach preserved 99.8% of observed behavior and reduced the exported API surface by 93%. This suggests that targeted code regeneration could be a feasible alternative to traditional software supply chains.
Why it matters: If widely adopted, this approach could significantly reduce software supply chain risks by enabling local verification of code rather than relying on external sources.
Jul 15, 2026
Research→Official→arXiv Software Engineering
CT-Repair is an automated program repair framework that leverages Code Property Graphs (CPG) and Temporal Execution Graphs (TEG) to represent static and dynamic evidence. It uses three finite-state-machine-guided agents to analyze bugs from static, dynamic, and hybrid perspectives, and applies a filtering pipeline that reduces runtime evidence by over 94%. On 854 Java bugs from Defects4J v3.0, CT-Repair correctly repairs 489 bugs in a mixed-model configuration and 388 bugs under a controlled GPT-5.4-mini configuration, outperforming ReinFix and RepairAgent.
Why it matters: This work demonstrates that structured runtime evidence and multi-perspective reasoning can significantly improve automated program repair effectiveness without relying solely on larger patch-generation budgets.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A new method called E3 (Estimate, Execute, Expand) enables large language model (LLM) agents to estimate task difficulty before execution, reducing unnecessary context processing. On the MSE-Bench benchmark, E3 matches the strongest baseline's 100% task success rate while reducing costs by 85%, tokens by 91%, and inspected files by 92%. Live tests with gpt-4o on a real open-source library confirm that E3 remains leaner and faster than alternatives at comparable task success.
Why it matters: This work demonstrates a significant advance in reducing computational redundancy and operational costs for LLM agents, improving their scalability and efficiency.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A new method called EVITA uses multi-objective optimization to automatically generate driving scenarios that test interactions among multiple autonomous vehicles (AVs). Unlike traditional approaches that focus on single-AV testing, EVITA is designed to uncover safety-critical behaviors that emerge only when multiple AVs interact. Experimental results indicate that EVITA produces a greater diversity of AV interactions compared to existing scenario generation methods.
Why it matters: This approach addresses a key gap in AV safety testing by enabling the discovery of critical multi-vehicle interaction scenarios that single-vehicle tests may miss.
Jul 15, 2026
Research→Official→arXiv Software Engineering
Researchers introduce Code-MUE, a black-box framework for measuring uncertainty in code large language models (LLMs) by analyzing execution-based semantic interaction graphs. The method quantifies semantic diversity using Von Neumann entropy and demonstrates a strong negative correlation with functional correctness (Spearman's up to -0.98) across eight models. Code-MUE outperforms lexical and embedding-based baselines for risk detection and selective prediction, addressing limitations of existing black-box uncertainty metrics for code.
Why it matters: This work provides a practical and effective approach to uncertainty estimation for closed-source code LLMs, supporting safer and more reliable automation in software engineering.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A large-scale empirical study of over 200,000 test artifacts from open-source projects finds that AI agents generate tests with nearly double the variety of boundary checks and higher rates of null-safety testing compared to human-written tests. However, these agent-generated tests also show a 37% higher candidate flakiness rate, largely due to reliance on file I/O and non-deterministic logic. Human-authored tests maintain a slight edge in assertion strength.
Why it matters: The findings highlight a key trade-off in adopting AI-generated tests: improved edge-case coverage comes at the cost of increased test flakiness, which could introduce hidden technical debt in software development pipelines.
Jul 15, 2026
Research→Official→arXiv Software Engineering
TraceSynth is a diffusion-based framework for generating synthetic kernel execution traces to augment limited real data for machine learning-based system diagnostics. It models traces as multi-channel sequences and applies constraint-guided repair to enforce system invariants. Experiments show that, for deterministic workloads, synthetic augmentation achieves up to 87.2% F1-Macro, with context length and constraint-guided repair significantly impacting quality. The approach reduces data collection costs while maintaining high performance for downstream tasks.
Why it matters: This work enables cost-effective augmentation of kernel traces in production observability pipelines, addressing runtime overhead, storage, and privacy constraints in industrial systems.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A new preprint on arXiv explores whether the acceptance and review effort of pull requests (PRs) can be predicted at the time of submission, before any reviewer discussion or CI feedback. Using the AIDev dataset, the authors show that tree-based machine learning models can predict PR acceptance with high accuracy (F1 scores above 0.95), but predicting review effort is much more challenging. The study finds that early PR models can help with triage, though review effort remains difficult to estimate from submission-time features alone.
Why it matters: This work provides early evidence that machine learning can assist maintainers in triaging both human- and AI-generated PRs, but highlights the limitations of automating review effort predictions.
Jul 15, 2026
Research→Official→arXiv Software Engineering
A new preprint demonstrates that using role-aware summaries as code representations can improve file-level bug localization performance by up to 40% in Hit@5 compared to file-path representations, while reducing storage requirements by 10-20x relative to raw source code. The study also shows that integrating these representations into the Agentless pipeline achieves 94% Hit@6, outperforming the baseline. The results highlight the importance of code representation choices for balancing accuracy and computational cost in LLM-driven software debugging.
Why it matters: This work identifies a practical approach to enhance both efficiency and effectiveness in LLM-based bug localization, which could directly benefit software development workflows.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Researchers introduce BackendForge, a benchmark comprising 56 backend generation tasks derived from real open-source applications. The benchmark evaluates whether large language models (LLMs) can generate deployable and behaviorally correct backend services from specifications and OpenAPI contracts. The best-performing model, GPT-5.5, succeeded on 55.4% of tasks under a base oracle but only 28.6% under a more stringent final oracle, highlighting significant challenges for LLMs in producing complete backend services.
Why it matters: BackendForge exposes a substantial gap in current LLMs' ability to generate fully functional backend services, underscoring a key limitation for agentic coding applications.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Researchers introduce WebDesignIter, a framework that integrates a persistent knowledge graph (WebAppArchKG) to combine repository structure with explicit design knowledge for iterative front-end code generation. Evaluated on the Web-Bench benchmark, WebDesignIter achieves an average Pass@2 improvement of 9.55 percentage points over existing baselines and surpasses general-purpose coding agents such as Claude Code and SWE-Agent, while using fewer input tokens. Ablation studies indicate that the inclusion of design knowledge is the most significant factor in its performance gains.
Why it matters: This work shows that explicitly incorporating design knowledge into LLM-based coding agents can substantially improve the reliability and efficiency of complex, repository-level code generation tasks.
Jul 14, 2026
Research→Official→arXiv Software Engineering
TerraRepair is a prototype large language model (LLM) agent that leverages tool grounding to repair Terraform misconfigurations identified by Infrastructure-as-Code (IaC) scanners. By retrieving dependency context, consulting provider schemas, and re-running scanners, TerraRepair significantly increases fix rates on AWS benchmarks—from 26.6% to 78.4% with Checkov and from 44.8% to 72.4% with Trivy—compared to a one-shot baseline. The agent also escalates issues when deployment-specific context is missing, reducing the risk of hallucinated fixes.
Why it matters: This work demonstrates that tool grounding can substantially improve the reliability and effectiveness of LLM-based automated repair for cloud infrastructure code, potentially reducing manual intervention.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new preprint presents the first systematic empirical study of sycophancy bias in large language models (LLMs) used for code smell detection. The authors find that LLMs are highly sensitive to misleading prompts, with decision flip rates up to 72% and false alignment rates over 90%. They introduce Evidence-Guided Debiasing Prompting (EGDP), which reduces these rates to 12% and 21%, respectively, by enforcing evidence-first reasoning.
Why it matters: This work identifies a major reliability risk in LLM-based code analysis and demonstrates a practical method to mitigate sycophancy bias.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Motif is a system that passively observes browser activity to identify recurring interaction patterns and recommends automations to users. In a study with eight participants, Motif discovered more automatable patterns than users identified themselves, and most participants found the generated programs useful and relevant to their routines.
Why it matters: Motif represents a shift toward system-initiated automation, potentially making web workflow automation more accessible to non-technical users by removing the need for them to explicitly identify tasks to automate.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Researchers propose a framework that leverages historical real-bug mechanisms to generate synthetic bugs, which are then used as feedback to guide large language model (LLM)-based unit test generation. By constructing structural and semantic representations of bug records and retrieving relevant mechanisms, the system instantiates synthetic bugs as feedback targets for iterative test improvement. Evaluation on the Defects4J benchmark shows that this approach improves real-bug detection compared to several baseline methods.
Why it matters: This work demonstrates a novel and effective method for enhancing the ability of LLM-generated unit tests to detect real software bugs, potentially increasing software reliability.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new preprint reports that model instability is a significant issue in software analytics, with repeated runs of the same optimizer agreeing on only 13.7% of test cases across 127 multi-objective software engineering optimization problems. The researchers show that by adjusting label allocation, model complexity, and scoring splits, agreement can be improved by a factor of 4.8 and the standard deviation of optimization error reduced by 22% on average, without degrading recommendation quality. The study argues that instability is not just noise but a measurable and manageable property, and recommends treating it as a standard evaluation axis.
Why it matters: This work provides a practical framework for measuring and managing model instability, which could enhance the reliability and trustworthiness of software engineering optimization tools.
Jul 14, 2026
Research→Official→arXiv Software Engineering
A new framework called ACQUIRE is proposed to enhance LLM-based code repair by explicitly acquiring repository knowledge before generating patches. The system uses a Questioner-Answerer collaboration to identify and fill knowledge gaps, resulting in more accurate repairs. On the SWE-bench Verified benchmark, ACQUIRE improves Pass@1 accuracy by up to 4.4 percentage points compared to prior pre-repair methods, with only modest overhead.
Why it matters: This approach addresses a major source of factual errors in LLM coding agents by systematically improving their understanding of code repositories before attempting repairs.
Jul 14, 2026
Research→Official→arXiv Software Engineering
Researchers introduce RepTran, a search-based method designed to repair Transformer models by focusing on their feed-forward networks. RepTran identifies suspicious weights using a combination of variance-based and bidirectional scores, then optimizes these weights through differential evolution. Evaluated on 18 fault benchmarks derived from CIFAR-100 and Tiny-ImageNet, RepTran achieved a 74.7% average repair rate, statistically outperforming existing DNN repair methods such as Arachne.
Why it matters: This work presents a novel approach for automated repair of Transformer models, potentially improving the reliability of AI-enabled software systems.
Jul 14, 2026