Watermarking Large Language Models Can Harm Medical Text Quality, Study Finds
A new arXiv preprint systematically evaluates five watermarking schemes across 11 large language models and 7 vision-language models on medical tasks. The study finds that watermarking can cause significant degradation in medical text outputs, including lexical corruption, hallucinated terminology, and misattribution of image findings. The authors argue that general-purpose benchmarks may miss these clinically relevant failures, emphasizing the need for domain-specific evaluation before deploying watermarked models in medicine.
Why it matters: The findings suggest that widely used watermarking techniques for AI traceability could introduce clinically significant errors, highlighting a potential safety risk for medical AI applications.
Full story at: arXiv AI/ML ↗