Adaptive Model Compression (AMC): Saliency-Driven Resource Allocation for Ultra-Low-Power Transformer Inference

Jul 14, 2026

Researchers have introduced Adaptive Model Compression (AMC), a framework that dynamically allocates hardware resources during transformer inference based on token saliency. AMC uses a multi-tier architecture to process important tokens at full precision while compressing less significant data, resulting in a 59.2% reduction in system energy and a 2.24x increase in throughput on 45nm CMOS hardware, with only a 3.6% drop in accuracy.

Why it matters: This approach could make it feasible to run large transformer models efficiently on edge devices, significantly improving battery life without major performance loss.

Full story at: arXiv Information Retrieval ↗