NeurIPS

When the review process goes silent, explore how to reclaim your data's voice

The silence from all four reviewers and the AC after an early rebuttal is a frustrating breakdown in the process, especially when a spotlight felt within reach.

4 min readMachine Learning

The silence after a rebuttal is always uncomfortable, but the total radio silence described here is a systemic failure, not a minor glitch. Submitting a response before the official discussion window opened on Jul 27 AoE, only to have it vanish into the void for all four reviewers and the AC, is a nightmare scenario for any researcher. What makes this more than a personal grievance is the corroborating detail: several of the authors are also reviewing this cycle, and they report receiving no email notifications for rebuttals on papers they are handling, specifically those posted early via the same button. This points to a likely root cause: submissions made before the window may have never triggered the underlying notification system. The platform did not lose the work; it simply never told anyone it was there.

This is a cautionary tale about trusting the interface's affordances over the official timeline. The "Rebuttal" button was available, so using it early felt logical, even proactive. But in this case, the tool's front-end behavior did not match the back-end processing. For our readers, the practical takeaway is harsh but clear: if a system allows an action before the official window, wait for the window to open. It is a small delay that can save you from a week of agonizing silence. The fact that the authors tried meta-comments, reviewer reminders, and direct emails to the PCs, all to no avail, suggests that when the pipeline breaks, manual workarounds are not a reliable safety net. The system failed them, but the lesson is to treat the official opening time as the only real deadline, not the button's availability.

This incident also connects to a broader theme we have been tracking in our coverage of AI-driven workflows. For instance, in our piece on Clean Data Starts With Catching AI Slop Before It Skews Your Model, we saw how automated detection tools can misfire when they are fed inputs they were not designed to handle. Here, the same principle applies: the review system's automation failed because it was fed a submission outside its expected parameters. Similarly, our exploration of Exploring Real-World Computer Vision: Deployments, Edge Models, and Current Challenges shows how models optimized for one environment often stumble when deployed elsewhere. The submission portal is no different; it was optimized for the standard flow, and this edge case broke it.

The deeper issue is one of trust and accountability. The authors mention they had a shot at an oral or spotlight based on initial scores. That hope is now in jeopardy not because of their science, but because of a procedural black hole. The open question for NeurIPS leadership is whether they will audit the logs for that specific window and manually trigger notifications, or whether they will let this cohort's work be silently penalized. For our readers, the concrete consequence to watch is whether the organizers acknowledge the timestamp mismatch as a system fault or dismiss it as user error. If they do not issue a correction or a retroactive notification, then the lesson is grim: the platform's buttons are merely suggestions, and the true, reliable signal is the official announcement email, which never came. We would tell any researcher facing this: document everything, send the early rebuttal again the second the window opens, and do not assume the system is listening until you see a confirmation for each reviewer.

From Machine Learning

we submitted our rebuttal via the "Rebuttal" button before the author/reviewer/AC discussion period officially opened (Jul 27 AoE). since then, we've gotten complete silence from all four reviewers and the AC

several of us are also reviewing this cycle. when the discussion period opened on Jul 27 AoE, we got no email notification for rebuttals on papers we're reviewing, specifically for the papers whose authors had also posted early via the "Rebuttal" button. so it feels like anything submitted before the window opened may simply have never triggered any notification

Read the original at Machine Learning