Policy-as-Prompt Moderation with LLMs: Risks and Governance Considerations

Jul 15, 2026

A new preprint examines the use of large language models (LLMs) for content moderation through 'policy-as-prompt' methods, where moderation policies are given to LLMs as natural-language prompts. The authors argue that this approach introduces specific risks and harms, and that simply writing prompts is not sufficient for effective or meaningful community governance. They propose several considerations for improving prompt governance but conclude that prompt-writing alone cannot ensure robust moderation outcomes.

Why it matters: This research highlights important limitations and governance challenges for AI-driven, prompt-based content moderation systems as their use expands in online communities.

Full story at: arXiv Computers and Society ↗