streams of thought

AI That Reasons in Motion, Depth, and Words Expands Beyond Text

Chain-of-thought reasoning has been a breakthrough, but it's still just words.

3 min readMachine Learning
AI That Reasons in Motion, Depth, and Words Expands Beyond Text
Ψ-0.6: Adaptive Streams of Thought in a Unified Vision-Language World Model [R]

Chain-of-thought reasoning gave AI a voice for thinking out loud, but that voice only speaks in words. The physical world does not. That gap is exactly what Ψ-0.6 targets, and it is worth paying attention to because it suggests the next stage of AI reasoning will not be more text but a flexible mix of representations. The model reasons in streams of thought that include depth, motion, camera pose, and imagined scenes, and reinforcement learning decides which stream to use for a given problem. That is a meaningful departure from the assumption that language is the natural medium for all intelligence.

What makes this practical rather than academic is the transfer from simulation to reality. Ψ-0.6 was trained on simulated rooms and then moved to real robot tabletops, which echoes the bet many labs are making on synthetic environments as a cheaper, safer route to capable models. We have covered that trend before in Why AI labs are betting on simulated environments for smarter models, and this work is a concrete validation of the approach. It also sidesteps one of the quiet struggles in open-weight development: assembling the right datasets for fine-tuning. Ψ-0.6 is trained to reason through multiple modalities, so it does not need a carefully curated set of text instructions to learn spatial tasks. It learns which representation to use on its own. For teams building on open models, that reduces a significant bottleneck, one we have examined in The quiet challenge of fine-tuning open-weight models.

The results are specific enough to take seriously. On MindCube, a complex spatial reasoning benchmark, Ψ-0.6 surpasses leading open-weight models in zero-shot settings. On FlowBench, it outperforms other world models at predicting object motion. More interesting than the benchmark numbers is the architectural claim: one model acts as perceiver, vision-language model, world model, reasoner, and policy. That consolidation matters because it hints at a future where we do not stitch together separate components for seeing, understanding, and acting. The model decides internally whether to think in words, depth maps, or imagined scenes. For users, that means fewer integration headaches and more robust behavior in tasks that require both language and physical intuition.

The open question is whether this flexibility scales beyond simulated rooms and tabletops. Real-world deployment involves messier perception, longer horizons, and consequences for mistakes. But the direction is clear, and it aligns with what we saw when Rivian acquired world model AI to build a smarter driving simulator: physical reasoning is becoming a core capability rather than an add-on. The detail to watch is how Ψ-0.6 handles the trade-off between reasoning depth and speed in real-time settings. If it can decide quickly when a depth map is enough and when a full imagined scene is necessary, then the path to robots and autonomous systems that reason like humans get closer. That is the practical consequence to track, not the benchmark scores.

From Machine Learning

Chain-of-thought transformed AI reasoning, but it is limited to words.

Introducing Ψ-0.6, one model that reasons in *streams of thought*: words, depth, motion, camera pose, and imagined scenes. And it learns when to use which!

Read the original at Machine Learning