A question on ICLR and NeurIPS deadlines, and OpenReview [D]

The recent Reddit post from /u/ihatesalad1 highlighting the confusion surrounding NeurIPS deadlines and potential ICLR resubmission touches on a growing anxiety within the AI research community – the unpredictable nature of peer review and the increasing pressure to publish. The situation described, where a submission languishes without communication after promising initial reviews, is unfortunately not uncommon. This uncertainty leaves researchers in a precarious position, forced to weigh the risks of abandoning a potentially valuable piece of work against the possibility of pursuing alternative avenues. It’s a symptom of a larger problem: a system increasingly reliant on opaque processes and often lacking in timely feedback, a problem we explored previously in "The Downsides of LLM-Generated Peer Reviews [D]" where the impact of automated assistance on review quality was questioned, and further complicated by the lack of transparency in their use. The dilemma presented – whether to resubmit to ICLR given the NeurIPS timeline – underscores the need for clearer guidelines and more responsive communication from conference organizers.

The core issue isn't simply about deadlines; it’s about respect for the researchers' time and investment. Spending months, often years, crafting a paper, only to be met with silence and ambiguity, is demoralizing. The question of OpenReview flagging a potential double-submission is a valid concern, but it highlights a more fundamental need for conferences to establish clear policies regarding concurrent submissions, particularly when the outcome of one process remains uncertain. Relatedly, the tips offered in “NeurIPS 2026: Tips that might convince AC? [D]” demonstrate the lengths researchers will go to navigate these complex systems, emphasizing the inherent subjectivity and, at times, arbitrariness of the review process. The fact that a reviewer’s score can seemingly shift unexpectedly, even after addressing concerns, speaks to a lack of consistent evaluation criteria and a reliance on individual biases. Apple’s recent improvements to Siri, as discussed in "Apple finally fixed Siri. So why does it feel anticlimactic?" also offer a relevant parallel; a significant investment and improvement can still feel underwhelming when the underlying processes remain opaque and difficult to understand.

This situation underscores a larger need for a more equitable and transparent system for evaluating AI research. The current model, heavily reliant on subjective peer review and conference acceptance, can be exclusionary and discouraging, particularly for researchers from underrepresented groups or those working on less conventional topics. While the conference system serves an important role in disseminating knowledge and fostering community, it shouldn’t be the sole determinant of a researcher's value or a paper's significance. The lack of clear communication, the unpredictable timelines, and the potential for arbitrary decisions all contribute to a climate of anxiety and uncertainty. This isn't about dismissing the importance of peer review; it’s about recognizing its limitations and advocating for improvements that prioritize fairness, transparency, and respect for the researchers who contribute to this vital field.

Looking ahead, it's worth considering alternative models for research dissemination. Pre-print servers, like arXiv, have already demonstrated the value of open access and rapid sharing of ideas. Could we see a shift towards a system that emphasizes continuous feedback and community-driven evaluation, alongside the traditional conference model? The current anxieties surrounding NeurIPS deadlines, and the broader frustrations with the peer review process, suggest that the status quo is unsustainable. The question becomes: how can we foster a more inclusive and transparent system that recognizes the value of all research, regardless of conference acceptance, and empowers researchers to share their work with the world?