neurips 2026: ACs and reviewers have disappeared [D]

The recent NeurIPS experience detailed in /u/extricableforsythia’s post highlights a concerning fragility within the peer review process, particularly as AI-driven research accelerates. The scenario – submitting a rebuttal before the official discussion period, followed by complete silence from reviewers and the Area Chair – speaks to a system increasingly vulnerable to technical glitches and communication breakdowns. This isn’t an isolated incident, as evidenced by the recent discussion around [Bad but typical NeurIPS experience?] and the frustrations many reviewers face, even when attempting to diligently assess submissions. The lack of email notifications for rebuttals, specifically when authors preemptively submit, suggests a deeper issue with the platform’s event triggering and communication infrastructure. It’s a frustrating situation, especially given the author’s initial optimism about securing an oral or spotlight presentation, and underscores the critical need for more robust and reliable systems to manage these complex interactions.

The core of the problem isn’t simply about a missed email; it’s about the potential for critical feedback and iterative improvement to be lost entirely. Peer review is meant to be a dynamic process, a conversation between authors and reviewers that refines research and strengthens its impact. When that conversation is abruptly cut off due to technical errors, the integrity of the process is compromised. The suggestions offered by the original poster – meta-comments, reviewer reminders, contacting the PCs – all represent attempts to salvage a situation that should have been avoidable in the first place. Moreover, the broader context of ensuring reproducibility, as discussed in [It’s time to desk reject papers that don't include code that can reproduce the results], reveals a growing demand for accountability and rigorous evaluation within the AI research community, making the reliable operation of the review process even more vital. It’s clear that a system that allows for the silent disappearance of reviewers and the potential loss of valuable feedback is not conducive to that goal.

The increasing volume of submissions, driven by both the rise of AI-assisted research and the overall expansion of the field, is undoubtedly putting immense pressure on the NeurIPS review system. However, this pressure demands a commensurate investment in infrastructure and process improvements, not a reliance on increasingly fragile and error-prone systems. The suggestion in [NeurIPS 2026: If the rebuttal addresses your concern, please raise your score] about reviewers acknowledging and adjusting scores based on rebuttals underscores the importance of responsiveness, a principle that’s directly undermined when communication channels break down. It’s not enough to simply have a platform for review; it must be a platform that reliably facilitates meaningful dialogue and ensures that all submitted materials are properly considered.

Looking ahead, the NeurIPS experience serves as a critical reminder that the future of AI research hinges not only on algorithmic innovation but also on the robustness of the systems that evaluate and disseminate that innovation. The reliance on automated processes and large-scale peer review necessitates a parallel investment in the underlying technical infrastructure. The question now is: how can conference organizers proactively address these vulnerabilities to ensure a fair, transparent, and reliable review process, particularly as the volume and complexity of submissions continue to grow? Perhaps a more layered notification system, incorporating multiple channels and redundancy checks, is needed to prevent similar situations from occurring in the future.