distractor documents

Testing the Lost in the Middle Effect on Real AI Models

It's refreshing to see someone actually test the "lost in the middle" phenomenon instead of just citing the paper. This user ran a clever, lazy experiment: insert a document with a made-up fact into a pile of distractors and slide it through every position, checking if the model contradicts itself. On Haiku 4.5 and Sonnet 5, up to 30 short docs? Zero flips. The one apparent flip was "3" vs "three", same answer, different format. That's not a failure; that's a formatting quirk.