backtesting
backtesting on Beyond Market Intelligence: a running collection of 2 stories we have gathered and hand-picked because they are worth your time. Every post here touches on backtesting in some way — the news, the analysis, the deep dives, and the occasional surprise find. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work with data. New stories are added to this page as we find them, so check back if you want to keep up with what is happening around backtesting, or subscribe to the RSS feed to get them as soon as they are published. Browse the collection below, or head back to the homepage to see everything Beyond Market Intelligence is covering right now.
Presentation: SafeChat: Building AI-Powered Safety Systems at Scale in a Real-Time Marketplace
Join Bruna Pereira of DoorDash to discover how they’ve built a scalable, AI-powered safety system for their real-time marketplace. This presentation details their innovative shift away from costly, LLM-only moderation pipelines. DoorDash implemented a hybrid approach—leveraging fast internal models for straightforward cases, nuanced LLM scoring, and flexible, no-code workflows with robust backtesting. The result? A significant reduction in safety incidents while managing millions of daily messages. Explore the architectural pattern behind this transformative solution and learn how to empower your own data journey.
How do you debug a forecasting model today when the error is quite bad?
Encountering unexpectedly poor forecast performance? Diagnosing the root cause goes beyond a single error score. Experienced practitioners systematically investigate discrepancies, often breaking down errors by key dimensions like customer, product, or time horizon. Many routinely build custom notebooks and visualizations to facilitate this analysis—a significant manual effort. We’re exploring common workflows used to pinpoint issues, potentially informing an open-source tool for streamlined forecast evaluation. See "What to consider when creating waterfall charts" for a related perspective on data visualization techniques.