Token Reduction Is Not Cost Reduction: Study Finds Compression Can Increase Billed Costs and Harm Task Success

Jul 15, 2026

A preprint analyzing 2,848 Claude Code runs across 103 tasks finds that reducing tool-output tokens does not reliably lower billed costs for API-based coding agents, as prompt-cache traffic accounts for about 87% of costs. The study also shows that compression can harm task completion, with patch application rates dropping from 27/40 to 15/40 on SWE-bench-derived Go tasks due to corrupted edit anchors.

Why it matters: This challenges the assumption that token reduction directly reduces costs for coding agents, emphasizing the need for billing metrics that account for both cost and task success.

Full story at: arXiv Computation and Language ↗