DialFork

When your AI agent follows instructions but forgets the procedure

Procedural hallucination is a failure mode that's easy to miss. An AI agent makes every correct tool call, speaks fluently, and yet stops following the procedure it was given, fetching the weather forecast but never telling you, then asking for a rating instead. DialFork, from Idiap Research Institute and Logitech, is the first benchmark to measure this overlooked third axis of agent behavior. It simulates dialogues, forks them with drift-inducing instructions, and tracks where each drift begins.