cortical encoding model

A 218-Million-Parameter Model Maps Brain Activity From Films You Watch

A 218-million-parameter model now predicts how your brain responds to films, TV, and songs, no scanner required.

3 min readMachine Learning

Santiago Ramón y Cajal proved the brain is made of separate cells by hand-drawing neurons under a microscope. A century later, a 218-million-parameter model named after him can predict how those same cells respond to any film, podcast, or song, without a scanner. This is not a distant research milestone; it is a practical tool released today on Hugging Face, and it changes what we ask of AI in neuroscience.

Cajal-1, built and trained on fMRI data from 2,000 people watching films and TV, predicts brain activity at 20,484 points across the cortex every 1.49 seconds. On Meta's held-out test set for TRIBE v2, it outperformed existing methods by 25% and matched real brain recordings in 27 of 32 tests. The implications for how we study media, cognition, and even therapeutic design are immediate. Rather than requiring expensive, immobile scanners, researchers can now approximate neural responses from any audio or video stimulus. This is the kind of accessible, action-oriented progress that transforms a discipline. It echoes the spirit of a new implant brings vision restoration closer for Stargardt patients, where practical tools, not just theory, are bringing biological outcomes within reach. Similarly, the open release of Cajal-1 invites the community to build, test, and challenge its predictions, accelerating discovery far faster than any single lab could.

Where this gets interesting is in the data itself. Training on 2,000 brains watching mass-market content means the model learns patterns from shared cultural experiences, the same blockbuster, the same emotional beat. That raises a question the creator is likely already considering: how well does Cajal-1 generalize to stimuli that fall outside its training distribution? Meta's recent clarification on data practices as web scraping policy is updated reminds us that the boundaries of consent, representation, and bias in training data are never settled. A model that excels on Hollywood narratives may stumble on a documentary about a niche subculture or an experimental film. The open-source nature of Cajal-1 means the community can probe these edges, and that is precisely where the next breakthroughs will come from.

The concrete takeaway is this: Cajal-1 makes brain simulation a commodity you can run in a Colab notebook today. The open weight release invites anyone to test its limits, and the specific benchmark to watch is how it handles stimuli that fall outside the curated film and TV dataset. If it generalizes well, we have a new standard for modeling human perception. If it doesn't, the gaps will teach us more about the brain than the matches do. Either way, the field moves forward, not with a press release, but with a model you can download and run.

From Machine Learning

I built and trained a 218-million-parameter model on fMRI data from 2,000 peoples brains as they watched films, TV, and images.

On the films Meta held out to test TRIBE v2, Cajal-1 is 25% more accurate and closer to the real brain in 27 of 32 recordings.

Read the original at Machine Learning