Apple Introduces Length Value Model for Token-Level Generation Length Control
Apple ML Research has proposed the Length Value Model (LenVM), a token-level framework that models the remaining generation length at each decoding step. LenVM formulates length modeling as a value estimation problem with a constant negative reward per token, enabling more fine-grained control over generation length compared to existing sequence-level approaches.
Why it matters: LenVM could enable more precise control over generation length, potentially improving inference efficiency and reasoning performance in autoregressive models.
Full story at: Apple Machine Learning Research ↗