desk rejected

When reviewing a paper takes hours but rejection comes in minutes, it's time to explore a smarter approach

Spending four hours reviewing a paper while sick, only to receive a desk rejection the next morning, is a frustratingly familiar experience.

3 min readMachine Learning

The system is broken when a reviewer invests four hours evaluating a paper, assigns a solid 3/4 score, and wakes up to a desk rejection. That is not a bug in the peer-review process, it is a symptom of a workflow that no longer matches the scale or speed of modern research. The reviewer in this case did the hard, human work of reading and assessing, only to have that effort rendered moot by a gatekeeping step that apparently did not consider the review at all. Worse, the same post notes whispers of users gaming the system with multiple accounts to bypass submission limits, all while legitimate work gets cut without substantive feedback.

We have said it before: the traditional peer-review model is straining under its own weight. In our piece on how AI is reshaping peer review at ICLR, we explored how tools are beginning to assist with the triage and review process. But assistance is not the same as replacement, and a desk-rejection decision that ignores a detailed review is a sign that the human and automated layers are not talking to each other. If a reviewer spends hours on a paper, that signal should feed back into the system, not land in a void. And if the system can be circumvented by someone who simply creates extra accounts, the integrity of the entire pipeline is in question.

What does this mean for researchers who are spending their limited time and energy on reviews? It means you need to think strategically about where you invest your effort. Writing papers that connect with top conference audiences, as we discussed in our guide on crafting submissions that resonate, is one half of the equation. The other half is understanding that the review process itself is a dataset, one that can be simulated, tested, and optimized. The Paper Review Harness project lets you run your work through 30 AI reviewer personas before submission. That is not a replacement for human judgment, but it is a practical way to catch the kind of misalignment that leads to desk rejections before your paper ever lands on an editor's desk.

The concrete takeaway is this: if you are spending hours on a review that may never be read, or submitting work that gets dismissed before it is evaluated, the problem is not your effort, it is the process. Demand transparency from venues about how desk rejections are decided. Use simulation tools to stress-test your paper against the biases and thresholds you cannot control. And watch whether conferences that accept AI-assisted reviewing also close the loopholes that allow bad actors to flood the system. The technology exists to make peer review faster and fairer. The question is whether the people running the system are ready to use it.

From Machine Learning

Just spend 4h reviewing a paper while I was sick, gave it a 3/4. This morning got an email saying it's desk rejected. I saw many people around me also have many papers desk rejected. I heard, though idk how true it is, some people use multiple accounts to bypass the 20 paper limit and all their paper got DR.

Read the original at Machine Learning