Study Finds LLM Watermarks Fail Forensic Readiness for Court Evidence
A new preprint evaluates three leading LLM watermarking methods—KGW, Unigram, and SynthID-Text—against legal admissibility standards, including the Daubert criteria and NIST forensic guidelines. The study finds that meaning-preserving paraphrasing removes watermarks in 100% of KGW and Unigram cases and 98.3% of SynthID cases, with high false-negative rates even before attack. None of the methods tested meet the evidentiary standards required for court use, raising serious concerns about their reliability for legal or regulatory purposes.
Why it matters: The findings challenge the foundational assumption behind emerging regulations that AI-generated content can be reliably identified for legal evidence using current watermarking techniques.
Full story at: arXiv Computation and Language ↗