NOHARM benchmark reveals severe harm potential in LLM medical advice; human-AI teaming shows promise

Jul 15, 2026

A new benchmark, NOHARM, evaluates 20 large language models (LLMs) and 4 clinical AI tools on 1,100 medical consultation cases, finding that direct use of AI-generated recommendations could result in severe harm in up to 24.6% of cases, with omission errors accounting for over 80% of severe errors. In a randomized study of 101 physicians, AI assistance improved performance, but physicians often omitted valuable AI recommendations, indicating complementary strengths in human-AI teaming.

Why it matters: This study provides the first systematic measurement of clinical safety in LLM-generated medical advice, revealing that widely used AI tools can produce potentially harmful recommendations and highlighting the need for explicit safety evaluation.

Full story at: arXiv Computers and Society ↗