Beyond Market Intelligence/on-policy self-distillation

on-policy self-distillation

Beyond Market Intelligence keeps on-policy self-distillation in one place: one story so far. The section currently leads with “Teaching Foundation Models New Skills Without Breaking Them”. Teaching foundation models new skills without breaking what they already know is one of the hardest challenges in AI. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work… The list below is every on-policy self-distillation story on Beyond Market Intelligence, newest first.

Towards Data Science

Teaching Foundation Models New Skills Without Breaking Them

Teaching foundation models new skills without breaking what they already know is one of the hardest challenges in AI. A new reinforcement learning approach, on-policy self-distillation, might finally offer a path forward. It's a promising idea, one that could reshape how we think about post-training. For a deeper look at how models are learning to build their own tools, see our coverage of Recursive's Flint.