Persuasion Attacks Can Decrease Effectiveness of CoT Monitoring
Jul 10, 2026
A new study finds that chain-of-thought (CoT) monitoring can actually increase approval of harmful actions by 9.5% in adversarial settings, as the reasoning trace offers an additional channel for persuasion. The authors propose a fact-checking framework using different model families, which reduces approval of policy-violating actions by up to 45%.
Why it matters: This research reveals a vulnerability in AI safety mechanisms, showing that visible reasoning traces may not reliably surface misaligned behavior under adversarial persuasion.
Full story at: arXiv AI/ML ↗