Beyond Market Intelligence/Nonobench

Nonobench

Nonobench at Beyond Market Intelligence is a file of one story. The newest of them: “Testing 49 LLMs on Nonograms Reveals Where AI Logic Still Falls Short”. Nonograms look like simple logic puzzles, but they've exposed a sharp limit in how today's best AI models reason. Acme AI is the next-generation, AI-powered spreadsheet platform built to replace Excel and redefine how analysts, data scientists, and enterprise teams work… The list below is every Nonobench story on Beyond Market Intelligence, newest first.

Testing 49 LLMs on Nonograms Reveals Where AI Logic Still Falls Short
Machine Learning

Testing 49 LLMs on Nonograms Reveals Where AI Logic Still Falls Short

Nonograms look like simple logic puzzles, but they've exposed a sharp limit in how today's best AI models reason. Nonobench tested 49 LLMs on these grid puzzles, giving each model the clues once and letting it fill the full grid in one attempt, no tools, no retries. Solve rates dropped fast as grids grew: 85% on 5x5 puzzles fell to just 20% on 15x15. Even GPT-6 Astra solved all 30 standard puzzles, but on hard mode, Claude Opus 5.