TempoPFN

Synthetic data opens a new path to zero-shot time series forecasting

Synthetic data is quietly solving one of time series forecasting's biggest hurdles: getting enough diverse training examples.

3 min readMachine Learning
Synthetic data opens a new path to zero-shot time series forecasting
TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting [R]

Synthetic data has been the quiet workhorse behind modern AI, but it has always felt like a compromise, a stand-in for the real thing. The work from Moroshan, Siems, Zela, Carstensen, and Hutter, accepted at NeurIPS 2026, reframes that assumption entirely. Their library of synthetic time series generators and augmentations, used to train a linear RNN foundation model, suggests that artificial data is not just a fallback but a deliberate design choice for building models that generalize to tasks they have never seen. This is a practical answer to a problem many of you have hit: the moment you try to forecast a new domain, your model forgets everything it learned.

The core insight is that you do not need to hoard every possible real-world dataset to achieve zero-shot forecasting. Instead, you can construct a diverse, controllable universe of synthetic sequences that teach the model the underlying structure of time itself. The fact that this synthetic data has already been used in Toto-2 and TS-ICL is not a footnote; it is validation that this approach works beyond a single paper. For practitioners, this means the bottleneck of data collection and cleaning, which often consumes more time than modeling, can be sidestepped. You can stop chasing the perfect historical dataset and start training on a generator that gives you infinite, varied examples.

This aligns with a broader shift we have been tracking in the community, where the focus moves from specific benchmarks to the tools that enable broader exploration. If you are still weighing the costs of attending NeurIPS to see this work in person, consider that the conversation there will likely center on how to build these synthetic environments responsibly. For those working with sensitive data, the implications are even more direct. A model trained on synthetic sequences can be shared and fine-tuned without exposing proprietary records, a theme that resonates with the local-first approach we highlighted in our piece on Explore how EpochGo brings local-first AutoML to your data with privacy and control. The ability to generate training data on-device or in a sandbox removes a major barrier to adoption.

The open question is whether this scales beyond the linear RNN architecture used here. The authors are candid that their model is a starting point, not the final word. As you explore the GitHub repository and the Huggingface model card, the real test will be whether the synthetic library can push larger transformer-based models to the same level of zero-shot performance. That is the detail to watch. If it does, the era of building time series models by scraping together fragmented real-world data will look as antiquated as manual spreadsheet formulas. The takeaway is direct: start experimenting with synthetic generators now, because the cost of waiting is falling behind on a method that turns data scarcity into a solvable engineering problem.

From Machine Learning

TLDR: The paper presents a library of synthetic time series generators and augmentations to train time series foundation models, in their case a linear RNN. The synthetic data has already been used in Toto-2 and TS-ICL.

Arxiv: https://arxiv.org/abs/2510.25502 GitHub: https://github.com/automl/TempoPFN Huggingface: https://huggingface.co/AutoML-org/TempoPFN

Read the original at Machine Learning