2 min readfrom Machine Learning

How to get rejected by IEEE T-PAMI with 'Excellent' scores?[D]

Our take

Hello everyone. Today, I share my experience as a junior researcher in Computer Vision, navigating a troubling situation with IEEE T-PAMI and the IEEE Ethics Office. Despite receiving three positive reviews—two marked "EXCELLENT" and one "GOOD"—our paper was rejected based on feedback from a supposed fourth reviewer. Strikingly, we later discovered this reviewer had submitted a positive assessment that was inexplicably withdrawn. With six months of silence from IEEE on our investigation request, I invite anyone who has faced similar challenges to share their insights.
How to get rejected by IEEE T-PAMI with 'Excellent' scores?[D]

The recent revelation from a junior researcher regarding their experience with IEEE T-PAMI raises significant questions about the integrity of the peer review process in academic publishing, particularly within the rapidly evolving field of computer vision. The author's story, which details receiving excellent scores from reviewers only to face rejection based on a mysteriously withdrawn review, underscores a critical flaw in the system. This incident is not isolated; it echoes broader concerns raised in articles like [A Simple Solution to Improve Broken Peer Review System at AI Conferences [R]](/post/a-simple-solution-to-improve-broken-peer-review-system-at-ai-cmpcl2em501zls0gltr1wwdodt), where the peer review process is scrutinized for its potential biases and inefficiencies. The stakes are high in a field driven by innovation and competitive research, as the consequences of a flawed review system can stall or even derail promising advancements.

The implications of this situation extend beyond the individual researcher. It highlights a systemic issue within academic publishing, where the opacity of the review process can lead to confusion and a sense of injustice among scholars. The anonymous researcher’s call for an investigation into the actions of the Associate Editor (AE) and the integrity of the submission system reflects a growing demand for accountability and transparency in how research is evaluated. If even a single positive review can be disregarded without sufficient explanation, what does that mean for the trust researchers place in the system? This predicament emphasizes the need for a more robust framework that allows for open dialogue and review accountability, particularly for emerging researchers who may lack the leverage to challenge such decisions.

Moreover, this incident raises important questions about the potential biases that can influence editorial decisions. The fact that the researcher encountered the fourth reviewer—who confirmed their positive review—suggests a breakdown in communication within the editorial team. This situation is indicative of a broader issue where institutional power dynamics may overshadow merit-based evaluations. As we look towards the future of academic publishing, it is crucial to consider how transparency and equity can be prioritized. In fields like computer vision, where the pace of innovation is rapid, a fair and efficient review process is essential to ensure that groundbreaking work does not go unrecognized simply due to administrative oversights.

As we reflect on this incident, it is vital for the academic community to engage in discussions about reforming peer review practices. The experiences shared by this researcher resonate with many who feel disenfranchised by a process that should, in theory, support their work and contributions to the field. The ongoing dialogue surrounding these issues is critical. For instance, how can institutions like IEEE and similar organizations ensure that their review processes are not only fair but also reflective of the diverse perspectives within the research community? The need for innovative solutions in peer review, akin to those discussed in Vite Version 8: Unified Rust-Based Bundler and Up to 30x Faster Builds, becomes increasingly apparent as we seek to build a more inclusive and productive environment for researchers.

In conclusion, the story of this junior researcher serves as a crucial reminder of the challenges within the academic publishing landscape. As we advocate for change, it is essential to remain vigilant about the integrity of the peer review process. Stakeholders across the academic spectrum must collaborate to ensure that the pathways for research dissemination are equitable and transparent, fostering an environment where innovation can truly thrive. How we choose to address these issues in the coming years will define the future of scholarly communication and the vitality of our research ecosystems.

How to get rejected by IEEE T-PAMI with 'Excellent' scores?[D]

Hello everyone. I am keeping my identity anonymous today to protect my professional career. I am a junior researcher in Computer Vision, and I am sharing this story because I have hit a devastating deadlock with IEEE T-PAMI and the IEEE Ethics Office.

Our Situation:

https://preview.redd.it/v0w62gzmn02h1.png?width=2000&format=png&auto=webp&s=a2d75a1e3a388debdf5b163cb9593c1f7f1c49d5

In the decision letter, we actually received three highly positive reviews (Two EXCELLENT, One GOOD). However, the AE rejected the paper by quoting comments from a "4th" reviewer.

The most staggering part: We later accidentally met the actual 4th reviewer. He CONFIRMED having submitted a POSITIVE review, which was strangely withdrawn by the editor in the backend before the final decision was made.

We have formally requested the IEEE (and Computer Society) to thoroughly investigate this issue, specifically asking them to check AE's backend activity logs in the submission system.

However, half a year has passed, and we have received no direct response.

Has anyone experienced something similar with IEEE or other top venues? Any advice or help bringing visibility to this would be greatly appreciated.

Evidence:

Below is the report to IEEE Ethics (identifying information has been covered):

https://preview.redd.it/e41vt2rsn02h1.png?width=3508&format=png&auto=webp&s=b2ee2d3f092dad5e20b45b9daeea7fa7b6f01d20

https://preview.redd.it/t29n03rsn02h1.png?width=3508&format=png&auto=webp&s=67aa6bc36aed76617af34e7913a203f9236bc536

https://preview.redd.it/6v5ys2rsn02h1.png?width=3508&format=png&auto=webp&s=f2452998f57f1b157d71b569dd5ff87e4d3d0b6c

https://preview.redd.it/epdxv2rsn02h1.png?width=3508&format=png&auto=webp&s=d01da8cdf9e3f6cd5be53f884b02b154f86d0b48

https://preview.redd.it/fuw3k3rsn02h1.png?width=3508&format=png&auto=webp&s=03e75f763a54429758102da4933af53511642e7d

https://preview.redd.it/xn0ze3rsn02h1.png?width=3508&format=png&auto=webp&s=9f00e88f186c0afa349d4a46439216ae57642d98

submitted by /u/cussealin
[link] [comments]

Read on the original site

Open the publisher's page for the full experience

View original article

Tagged with

#financial modeling with spreadsheets#rows.com#IEEE T-PAMI#Computer Vision#excellent scores#rejection#positive reviews#AE (Associate Editor)#fourth reviewer#editor#submission system#ethics office#backend activity logs#formal request#investigation#academic integrity#decision letter#junior researcher#positive review confirmation#IEEE Ethics