Policy Safety→Official→arXiv Computers and Society
A preprint study analyzing 29 language models across 177 occupations finds that these models incorporate demographic information into simulated hiring decisions, advantaging female and Black candidates while penalizing disabled candidates. The research shows that post-training alignment—intended to make models more helpful and aligned with human preferences—substantially amplifies these demographic effects, with the female and Black advantage increasing by nearly 400% and the disability penalty worsening by over 150%.
Why it matters: The findings highlight that alignment processes, while designed to improve AI behavior, can unintentionally exacerbate certain forms of discrimination, particularly against disabled individuals, in high-stakes contexts like hiring.
Jul 16, 2026
Policy Safety→Official→arXiv Computers and Society
A new preprint analyzes the environmental impacts of sovereign AI infrastructure in the Global South, focusing on water, energy, and carbon emissions. The study finds that a 1,024-GPU cluster using evaporative cooling in the UAE would consume over 30 million liters of water annually, despite the country's extremely high water stress. The authors identify a 'sovereignty-sustainability trilemma' and propose design principles such as mandatory water usage reporting and prioritizing smaller, more efficient language models.
Why it matters: The research underscores the urgent need for policymakers in water- and climate-vulnerable regions to consider environmental sustainability when planning AI infrastructure.
Jul 16, 2026
Research→Official→arXiv Computers and Society
This preprint reports the first classroom deployment of LEA, an adaptive AI tutoring agent, with real students and evaluates its scalability across three different courses. The study finds that synthetic (simulated) evaluation does not fully predict real-world classroom performance: while answer relevancy and context precision remain stable across courses, faithfulness of responses declines as the curriculum diverges from the system's original subject. These results highlight the need for further research into making AI tutoring systems fully course-agnostic.
Why it matters: This work provides early empirical evidence on the challenges of deploying AI tutoring systems in real classrooms and exposes the limitations of relying solely on synthetic evaluation for predicting real-world performance.
Jul 16, 2026
Research→Official→arXiv Computers and Society
A new preprint investigates how large language models (LLMs) acquire and adjust to human values during post-training. The study finds that supervised fine-tuning (SFT) largely determines a model's value alignment, while subsequent preference optimization rarely changes these values significantly. Experiments with Llama-3 and Qwen-3 models further show that different preference optimization algorithms can result in different value alignment outcomes, even when using the same data.
Why it matters: Understanding when and how LLMs learn human values can guide better data curation and algorithm choices for improved model alignment.
Jul 16, 2026
Research→Official→arXiv Computers and Society
Researchers investigate cross-rubric generalization in automated essay scoring, where models trained on essays labeled with one set of rubrics are evaluated on essays scored with previously unseen rubrics. By introducing rubric-agnostic intermediate representations called 'traits' and using a fine-tuning framework, they achieve a 5.0% macro F1 improvement over baselines in the most challenging setting. Their best open-source Llama-based model also outperforms GPT-5-mini prompting by 2.1% macro F1.
Why it matters: This work demonstrates a method for automated essay scoring systems to adapt to new or revised scoring rubrics without retraining, addressing a practical challenge in educational assessment.
Jul 16, 2026
Research→Official→arXiv Computers and Society
Researchers have introduced L2-Bench, an open-source benchmark comprising over 1,000 task-response pairs designed to evaluate large language models (LLMs) in second language (L2) education. The benchmark covers 12 competencies and 31 subcompetencies, validated by more than 200 expert practitioners, and uses a rubric-based evaluation methodology. Results show that Claude Opus 4.7 achieves the highest overall performance at 85.5%, though it is marginally outperformed on some specific tasks. The study also finds that model performance declines on more challenging tasks.
Why it matters: L2-Bench offers a rigorous, pedagogy-driven framework for assessing AI models in language education, enabling stakeholders to make more informed decisions about AI adoption in this field.
Jul 16, 2026
Research→Official→arXiv Computers and Society
A study analyzing Kaggle contest submissions from 2019 to mid-2026 finds that AI coding assistants have led to substantial syntactic homogenization—code structure and literal syntax have become more similar—while semantic diversity, reflecting problem-solving approaches, has remained stable or even expanded. The research also documents widespread convergence toward the random seed value 42, consistent with LLMs reinforcing established programming conventions. These findings are based on both surface-level (TF-IDF) and semantic (embedding-based) analyses of code similarity.
Why it matters: This suggests that while AI coding assistants standardize implementation details, they do not currently reduce the diversity of problem-solving strategies, informing debates about software monoculture and innovation.
Jul 16, 2026
Research→Official→arXiv Computers and Society
A longitudinal study of Microsoft 365 Copilot adoption at a state Department of Transportation found that perceived usefulness of the tool declined significantly after an eight-week pilot, while perceived ease of use, behavioral intention, and trust showed only minor, nonsignificant changes. The research identified three baseline user personas—Skeptics, Cautiously Positive users, and Champions—with substantial individual movement between groups, including 68% of Champions shifting to less enthusiastic personas. The study also observed that while some concerns (accuracy, privacy) decreased, worries about job impact and required skills increased.
Why it matters: This study provides empirical evidence that employee enthusiasm for generative AI tools can wane after real-world use, highlighting the need for ongoing expectation management and tailored support in enterprise AI deployments.
Jul 16, 2026
Research→Official→arXiv Computers and Society
A new preprint audits nine leading large language models (LLMs) for asset-specific preferences and finds that Bitcoin's ranking among money-like instruments is highly dependent on the scenario presented, with models ranking it higher in crisis and autonomous-agent contexts. The study identifies a dominant internal feature in Gemma 3 that selectively represents Bitcoin; manipulating this feature can causally shift the model's portfolio allocation toward or away from Bitcoin by up to 5.2 percentage points. This demonstrates that internal model representations can be both audited and causally linked to real financial decisions.
Why it matters: This work provides a concrete method for auditing and influencing asset-specific preferences in financial LLMs, laying groundwork for transparency and accountability as such models are deployed in real-world financial decision-making.
Jul 16, 2026
Research→Official→arXiv Computers and Society
A new preprint finds that large language models (LLMs) generate responses that are more concentrated and mainstream than the diverse, long-tail outputs produced by humans. The researchers tested interventions such as increasing temperature sampling, prompting for diverse perspectives, and aggregating outputs from multiple models, finding that these methods can improve diversity, but single-model outputs still fall short of human-level diversity.
Why it matters: The study raises concerns that LLMs could reduce cultural diversity in generated content, which has implications for AI policy and the preservation of democratic values.
Jul 15, 2026
Policy Safety→Official→arXiv Computers and Society
A new benchmark, NOHARM, evaluates 20 large language models (LLMs) and 4 clinical AI tools on 1,100 medical consultation cases, finding that direct use of AI-generated recommendations could result in severe harm in up to 24.6% of cases, with omission errors accounting for over 80% of severe errors. In a randomized study of 101 physicians, AI assistance improved performance, but physicians often omitted valuable AI recommendations, indicating complementary strengths in human-AI teaming.
Why it matters: This study provides the first systematic measurement of clinical safety in LLM-generated medical advice, revealing that widely used AI tools can produce potentially harmful recommendations and highlighting the need for explicit safety evaluation.
Jul 15, 2026
Research→Official→arXiv Computers and Society
Researchers introduce EG-VAR, a Lean 4-based tool-calling architecture that ensures every verified output is grounded in attested tool calls and kernel-checked inference, thereby eliminating unsupported claims. On a subset of TableBench numerical reasoning tasks (n=120), EG-VAR achieves perfect accuracy (120/120) compared to a 95% baseline, and maintains 100% source-faithfulness on stress tests where baselines drop to 80-90%. The system also provides explicit audit trails for abstentions and formalization errors.
Why it matters: EG-VAR offers a practical and auditable approach to eliminating LLM hallucination in empirical inference, potentially transforming trustworthiness in high-stakes AI applications.
Jul 15, 2026
Research→Official→arXiv Computers and Society
A new preprint compares large language models (LLMs) such as GPT, Twitter-roBERTa, and LLaMA to traditional machine learning methods for analyzing open-ended survey responses. The study finds that LLMs achieve higher classification accuracy, especially in sentiment and thematic analysis, but exhibit significant variation in consistency and the explicitness of their reasoning. These results highlight important trade-offs between predictive performance and interpretability in large-scale qualitative research.
Why it matters: The study offers practical insights for researchers seeking to balance automation with interpretive rigor when applying LLMs to qualitative data analysis.
Jul 15, 2026
Research→Official→arXiv Computers and Society
AgentSociety 2 is a new research environment that integrates large language model (LLM) agents as both AI social scientists and simulated participants, automating the end-to-end workflow of social science research. The system enables hypothesis generation, experiment design, simulation execution, result interpretation, and manuscript drafting across micro, meso, and macro social scenarios. It demonstrates the ability to reproduce qualitative patterns from prior studies and supports large-scale, auditable simulations.
Why it matters: This work advances computational social science by providing a scalable, reproducible, and auditable platform for automating complex social experiments with AI agents.
Jul 15, 2026
Research→Official→arXiv Computers and Society
A new preprint examines the use of large language models (LLMs) for content moderation through 'policy-as-prompt' methods, where moderation policies are given to LLMs as natural-language prompts. The authors argue that this approach introduces specific risks and harms, and that simply writing prompts is not sufficient for effective or meaningful community governance. They propose several considerations for improving prompt governance but conclude that prompt-writing alone cannot ensure robust moderation outcomes.
Why it matters: This research highlights important limitations and governance challenges for AI-driven, prompt-based content moderation systems as their use expands in online communities.
Jul 15, 2026
Research→Official→arXiv Computers and Society
A new preprint compares institutional and course-level generative AI policies at U.S. research-intensive universities. The study finds that while institutions tend to be more supportive of GenAI use, course-level guidance in computing education remains cautious. The authors propose an instructor-centered framework to guide future GenAI adoption in courses.
Why it matters: This research highlights a disconnect between university-wide AI policies and classroom practices, offering a framework to help computing educators navigate GenAI adoption.
Jul 15, 2026
Policy Safety→Official→arXiv Computers and Society
AAAI-26 organizers report a significant increase in dual submissions—papers submitted to multiple venues without disclosure—during the conference's review process. By combining similarity assessment, LLM-based overlap tools, and manual review, they desk-rejected 141 main-track submissions. The organizers warn that generative AI may be enabling more sophisticated forms of dual submission and propose several policy and technical recommendations to address the issue.
Why it matters: This development exposes a growing integrity challenge in AI research, with generative AI potentially exacerbating threats to the peer-review process and the reliability of the scientific record.
Jul 15, 2026
Research→Official→arXiv Computers and Society
A new preprint examines how transfer learning can be applied to adaptive multi-agent systems facing policy regime changes. The authors compare blank-slate learners with transfer learners that reuse structural knowledge from previous regimes, using an emissions-regulation simulation. Results show that transfer learning improves performance when the policy-outcome relationship remains stable, but can lead to negative transfer when a regime change introduces a threshold break. The paper provides a methodological framework for determining when regulatory experience should be reused or discarded.
Why it matters: This work offers a formal approach to understanding the risks and benefits of transfer learning in policy modeling for adaptive socio-technical systems, informing the design of AI-driven regulatory tools.
Jul 14, 2026
Policy Safety→Official→arXiv Computers and Society
A new preprint argues that as AI models approach top performance on existing benchmarks, the remaining discriminating items are those requiring elite expert judgment, which is structurally scarce. The authors present a formal model showing how benchmark signal depreciates as models improve, and document a scarcity premium for high-judgment evaluation labor. The paper also discusses the governance implications of these findings for AI capability measurement.
Why it matters: This work highlights a fundamental bottleneck in evaluating advanced AI systems, raising concerns about the reliability of current benchmarks and the challenges for AI governance.
Jul 14, 2026
Research→Official→arXiv Computers and Society
A new preprint explores 'model collapse,' the phenomenon where recursively training AI models on AI-generated data leads to degraded performance, such as repetition and noise. The author argues that while this is typically seen as a technical failure, it also has creative and aesthetic dimensions, drawing parallels to early video feedback art. The paper examines how model collapse challenges certain technological ideals and underscores AI's ongoing reliance on human-generated data.
Why it matters: This research reframes model collapse as not only a technical issue but also a source of artistic and philosophical insight, broadening our understanding of AI's creative potential and limitations.
Jul 14, 2026