BONSAI: Optimizing Decoding Tries for LLM-Based Generative Recommendation
Researchers have introduced BONSAI, a framework that optimizes the structure of decoding tries in large language model (LLM)-based generative recommendation systems. BONSAI co-designs textual term IDs and their underlying trie structure by ensuring adaptive ID lengths and constrained branching factors, which improves the effectiveness of constrained beam search. Experiments show that BONSAI achieves up to a 21.6% relative improvement over state-of-the-art baselines in generative recommendation tasks.
Why it matters: This work demonstrates that optimizing the decoding trie structure can significantly enhance the performance of LLM-based generative recommendation systems, addressing an overlooked aspect of their design.
Full story at: arXiv Information Retrieval ↗