NeurIPS

Missing Feedback Raises Questions in NeurIPS Paper Rejections

A rejection is already hard to process, but receiving no final comment while your meta-review sits unchanged since July raises fair questions.

4 min readMachine Learning

A rejection is never easy to digest, but a rejection that arrives without explanation feels less like a verdict and more like a dead end. The researcher who posted about their NeurIPS submission, rated 4-4-4 and dismissed with a meta-review unchanged since July, isn't just upset about the outcome. They are questioning the process itself. And honestly, they have a point. When a conference explicitly promises careful, useful feedback especially for borderline cases, and then delivers a carbon copy of an earlier review with no final justification, the gap between the promise and the experience becomes the real problem. This is not about entitlement. It is about accountability in a system that asks for trust while offering little in return.

We have seen this pattern before in other corners of the AI community. Building systems, whether recommendation engines or computer vision models, always comes down to understanding the gap between what was intended and what was actually delivered. As we explored in our piece on real-world computer vision deployments, the hardest problems are rarely the algorithms themselves. They are the silent failures in feedback loops, the cases where the model quietly misses the mark and no one notices until it matters. Similarly, when a reviewer's feedback disappears into a void, the researcher is left with no signal to improve. The same principle applies here: feedback is only useful if it is timely, specific, and honest about its own limitations. The Exploring Real-World Computer Vision: Deployments, Edge Models, and Current Challenges case reminds us that iteration is the lifeblood of progress, and you cannot iterate on silence.

What makes this situation particularly frustrating is that the tools for better communication already exist. We have seen how adaptive systems, like those discussed in our piece on evolving recommendations, thrive on continuous input and adjustment. They do not wait for a perfect signal; they learn from every interaction. A conference review process could learn something from that mindset. Instead of treating the meta-review as a final stamp, what if it were treated as a living document, one that acknowledges the discussion that happened (or did not happen) after the initial reviews? The Evolve Your Recommendations: Real-World Insights on Adaptive Systems article shows that even complex systems benefit from transparent, incremental updates. A simple line like "we considered the author response and found it did not change our assessment" would have been enough. It would not have made the rejection sting less, but it would have made the process feel human.

So what should a researcher in this position actually do? First, recognize that this is not a reflection of your work's value. The 4-4-4 score is a specific, if limited, data point. Second, push back politely. Ask the program chairs for the missing final justification. You might not get it, but you will have documented the gap. Third, and this is the takeaway we would offer, use this as a test case for how you want to handle feedback in your own work. Whether you are building a spreadsheet model or a neural network, the principle is the same: feedback loops only work if they are closed. The question we should all be asking, as authors, reviewers, and conference organizers, is not just whether a paper was accepted, but whether the process left everyone involved better equipped for the next round. Because right now, the only thing that is certain is that silence does not teach anyone anything, except maybe how to disengage. And that is a lesson none of us can afford to learn.

From Machine Learning

Do all the rejected or accepted papers get a "Final Justification" comment from the PC?

Mine got rejected with ratings 4-4-4 yet the meta review is the exact same as the one that was posted originally in July and I didn't get any final comment. I find it a bit harsh especially since in the rejection e-mail they state how much effort they asked AC and SAC for careful reviewing and useful feedback, "especially in borderline cases"...

Read the original at Machine Learning