SwarmEvolve

Making math faster: an open-source path to cheaper AI discovery

Google DeepMind's AlphaEvolve shattered a 1969 record by finding faster ways to multiply complex matrices, but it runs on expensive, proprietary Gemini models.

3 min readMachine Learning

Speed matters in scientific discovery, and SwarmEvolve proves that the open-source community can deliver it without waiting for the next flagship model. This paper, submitted by a research group that saw an opportunity to improve on Google DeepMind's AlphaEvolve, demonstrates a practical truth we have long believed: the path to cheaper AI discovery runs through smarter architecture, not just bigger compute budgets. By running swarms of hundreds of small, latent-reasoning agents on models as modest as Qwen3 8B, the team achieved in roughly five minutes what comparable open-source frameworks took over an hour to accomplish. That is not an incremental gain; it is a functional leap that changes what smaller teams can attempt.

The technical insight here is worth pausing over. Instead of forcing each agent to articulate its reasoning in natural language, SwarmEvolve lets agents pass compressed internal states, KV caches, directly to one another. Ideas mix inside the model without the overhead of full text generation. This approach aligns with broader trends we have covered, such as how Explore how LLM inference architecture evolves through open discussion and how researchers are finding ways to make models more efficient without doubling their size, as seen in Scaling AI training with lightweight adapters instead of doubling models. SwarmEvolve takes that same philosophy and applies it to the discovery process itself: run many cheap agents in parallel, let them share compressed reasoning, and let the swarm converge on solutions faster than any single expensive model could.

What makes this work stand out is its consistency across model scales. The 8B version matched the best known results for circle packing, a classic optimization problem, while larger models pushed performance further. That is a concrete signal that the framework is not just a trick that works only at one size. It suggests that researchers without access to massive GPU clusters can still participate in frontier math discovery. The project has already been extended to work with Qwen3.5 and Muse models, showing better performance, which points toward a future where these swarms become a standard tool rather than a one-off experiment.

The open question is whether this approach can scale to the messy, high-dimensional problems in material science or biology, which the team explicitly invites collaboration on. That is the next threshold. For now, the takeaway is specific and actionable: if you are working on math discovery or optimization and have been priced out by the compute demands of existing frameworks, SwarmEvolve offers a path forward that runs on hardware you likely already have. Watch how the community responds to the code release, because the real test of any open-source framework is whether others can reproduce the results and extend them.

From Machine Learning

Last year Google DeepMind's AlphaEvolve found a faster way to multiply 4x4 complex matrices, beating a record that had stood since 1969. The idea is to let an LLM write a program, score it, and iteratively improve it. So it's called "evolve".

But AlphaEvolve runs on Gemini models. Similar open-source implementations are also usually slow and expensive. We tried to make it faster, cheaper, and better.

Read the original at Machine Learning