History Compression

One transformer model replaced 15 specialized generators in Yandex Music's A/B test

One transformer replaced 15 specialized generators in Yandex Music's production stack. That's the kind of result that makes you rethink how we build recommenders. Sona, their single-model generative recommender, achieved a +4.53% lift in Active Users and +6.30% in Total Listening Time on smart speakers. History Compression cuts inference cost roughly in half while retaining most of the quality. For deeper context on how models manage long contexts efficiently, see our article on smarter token compression techniques.