Beyond Market Intelligence/SOTA

SOTA

SOTA on Beyond Market Intelligence: a running collection of 3 stories we have gathered and hand-picked because they are worth your time. Every post here touches on sota in some way — the news, the analysis, the deep dives, and the occasional surprise find. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work with data. New stories are added to this page as we find them, so check back if you want to keep up with what is happening around sota, or subscribe to the RSS feed to get them as soon as they are published. Browse the collection below, or head back to the homepage to see everything Beyond Market Intelligence is covering right now.

You can beat SOTA Time Series Anomaly Detection methods with a 100 year old algorithm [R]
Machine Learning

You can beat SOTA Time Series Anomaly Detection methods with a 100 year old algorithm [R]

Recent advancements in Time Series Anomaly Detection (TSAD) have generated significant interest within leading AI conferences. However, a critical analysis reveals a surprising finding: established state-of-the-art (SOTA) methods are frequently outperformed by a century-old technique, Statistical Process Control (SPC). Testing benchmark datasets demonstrates SPC's remarkable ability to achieve perfect results in many cases, suggesting current benchmarks may be overly simplistic. This calls for introspection within the TSAD community regarding evaluation metrics and the true measure of progress.

How we built a SOTA search engine using PostgreSQL, pgvector, and Qwen3 embeddings [P]
Machine Learning

How we built a SOTA search engine using PostgreSQL, pgvector, and Qwen3 embeddings [P]

Papers with Code now delivers superior search results through a hybrid approach combining keyword and semantic analysis. Our system leverages PostgreSQL with pgvector for efficient vector storage, Qwen3 embeddings for nuanced text understanding, and Hugging Face's infrastructure—Jobs, Buckets, and Inference Endpoints—to power both search and related paper recommendations. This architecture, detailed in our technical breakdown, demonstrates a scalable solution for research content.

Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII [P]
Machine Learning

Introducing ASCIITermDraw Bench | Testing the ability of VLMs to Generate and Edit ASCII [P]

Can AI truly visualize complex concepts beyond code? Introducing ASCIITermDraw-Bench, a new benchmark evaluating Vision Language Models' ability to generate and edit diagrams using simple ASCII characters. This innovative benchmark addresses a critical gap, moving beyond coding and reasoning to assess diagrammatic accuracy—a surprisingly challenging task. Featuring 80 tasks spanning network topologies to software architecture, ASCIITermDraw-Bench offers a rigorous evaluation with structural and semantic scoring. See current leaderboards, including Gemma-4-31B-IT at 73.8%, and explore the methodology on Hugging Face.