local-first applications

Local-First AI: Why Your Next Spreadsheet Runs On-Device

Your spreadsheet shouldn't need to phone home to the cloud just to help you sort a column.

3 min readInfoQ
Local-First AI: Why Your Next Spreadsheet Runs On-Device

The local-first movement has been building quietly for years, and Rachel Lee Nabors' deep dive into on-device AI for spreadsheets finally gives it the practical framing it deserves. Her argument is straightforward: small language models running directly on your machine can handle the most frequent data tasks with better privacy, lower latency, and no per-query cloud costs. We think this is the architecture that will define the next generation of spreadsheet tools, and it's worth understanding why today.

The promise of AI-assisted data work has, until now, been tied to cloud-hosted large language models. That model works for complex, one-off queries, but it breaks down for the repetitive, context-sensitive operations that dominate real spreadsheet use, things like cleaning inconsistent date formats, suggesting formula corrections, or generating summaries of a column's distribution. Every round trip to a server introduces latency, raises privacy concerns, and adds a variable cost that makes it hard to justify for routine tasks. Local-first flips this: the model is already on your device, so it responds instantly, never sends your data elsewhere, and costs nothing per interaction. This isn't a theoretical trade-off. As we explored in our piece on AI Agents in the Wild, real-world encounters with AI often reveal that small, fast, predictable interactions matter more than occasional feats of reasoning. The local-first approach aligns directly with that insight.

What makes Nabors' analysis particularly useful is that she doesn't frame this as a replacement for cloud AI. Instead, she positions small language models as the workhorses for the 80% of tasks that don't require a large model's full capacity. That distinction matters because it points toward a hybrid future: your spreadsheet might use an on-device model for instant autocomplete and data validation, then escalate to a cloud model only when you ask it to analyze a complex trend or generate a narrative report. This layered architecture is more resilient and more practical than either extreme alone. It also echoes the shift we described in Reimagining the workplace where AI handles tasks so people can lead, where the goal is not to automate everything at once, but to delegate the predictable so humans can focus on judgment and strategy.

The concrete takeaway for anyone building or evaluating spreadsheet tools is this: the next competitive differentiator will not be which model you use, but where you run it. A spreadsheet that processes every keystroke through a cloud API will always feel sluggish and raise adoption barriers. One that keeps the AI local, responsive, and private will feel like a natural extension of the tool itself. The open question, and the detail we will be watching closely, is how well on-device models handle the long tail of domain-specific spreadsheet tasks, like financial modeling or scientific data formatting, without requiring users to download massive model files. If the answer is "well enough," the local-first spreadsheet becomes not just a privacy upgrade, but a performance standard.

From InfoQ

Rachel Lee Nabors, former React core team member, dives into the architecture and philosophy behind local-first applications, exploring how small language models (SLMs) running directly on-device can deliver privacy-focused, low-latency, and cost-effective alternatives to cloud-hosted LLM wrappers.

Read the original at InfoQ