How to file a complaint about a published CVPR paper? [R]

The recent Reddit post questioning the complaint process for a CVPR 2026 paper centered around a missing dataset highlights a growing tension within the AI research community: the increasing expectation of open science versus the realities of publication pressures and author responsibility. The core issue, as articulated by /u/ElPelana, is the publication of a paper whose primary contribution—a dataset—was never released, despite a promised GitHub repository remaining persistently empty. This isn't merely an inconvenience; it undermines the reproducibility of research, a cornerstone of scientific progress. We’ve seen similar challenges emerge in other domains, such as the materials science space, where companies like Discovered Materials are actively seeking novel materials, demonstrating the crucial role of accessible data in driving innovation [Discovered Materials is playing AI whack-a-mole to hunt cooler chips]. The lack of dataset availability creates a significant barrier to validating findings and building upon existing work, essentially rendering the paper’s contribution moot. The frustration expressed by the poster is understandable, particularly given the implicit understanding that dataset release should be a prerequisite for publication, a standard increasingly emphasized by conferences and journals.

The difficulty in knowing *who* to contact to lodge a complaint further exacerbates the problem. While the authors' lack of response is disappointing, it points to a systemic issue: a lack of clear accountability and enforcement mechanisms within the conference review process. Current systems often rely on self-reporting and good faith adherence to data sharing policies. The fact that the paper was accepted and published despite the empty GitHub link suggests a potential failure in the pre-publication checks. This is especially concerning given the increasing complexity of AI research, where datasets often represent a substantial portion of the work. The problem is amplified by the speed of progress; as Anthropic demonstrates with the evolving capabilities of Claude Code [Anthropic is turning Claude Code’s auto mode on by default], the need for readily verifiable results becomes even more critical. Researchers building upon published work need assurance that the foundational data is accessible, and the current system leaves room for significant ambiguity. A similar concern arose recently with adversarial patterns designed to evade surveillance systems [This ‘adversarial’ pattern can prevent surveillance cameras from detecting you], highlighting the need for robust validation of research claims and underlying data.

The broader significance of this situation extends beyond a single paper. It underscores a need for a more rigorous approach to data validation *before* publication. Conferences should consider implementing stricter requirements, perhaps involving a data availability check as part of the peer-review process, or even requiring a data deposit in a trusted repository prior to acceptance. Furthermore, clear channels for reporting and addressing such issues are essential, moving beyond simply relying on author responsiveness. This could involve a dedicated ethics committee or a more formalized complaint process within the conference organization. The current reliance on informal communication leaves researchers vulnerable to wasted effort and undermines the integrity of the scientific record. The pressure to publish, often driven by academic career advancement, can incentivize authors to prioritize speed over responsible data sharing, creating a perverse incentive structure that needs to be addressed.

Ultimately, this incident serves as a call to action for the AI research community. While the push for open science is gaining momentum, practical implementation and enforcement remain a challenge. The question now is not *if* data sharing should be a requirement, but *how* we can create a system that effectively ensures it, holding researchers accountable for their commitments and safeguarding the integrity of the field. Will conferences and journals adopt more stringent data validation protocols, or will the reliance on author self-reporting continue to create opportunities for similar issues to arise, hindering progress and eroding trust in published research?