1 min readfrom Machine Learning

Submitting to top ML Conferences without Sharing code [D]

Our take

As the NIPS deadline approaches, a pressing question arises: Should we continue to share code with our conference submissions? Historically, I have always included code, but recent experiences suggest that reviewers may not prioritize it as much as we think. Some colleagues have successfully submitted without code, sparking curiosity about the evolving expectations in the ML community. This raises important considerations regarding reproducibility, including algorithm details and hyperparameter tuning. Are concerns about intellectual property theft justifying a shift away from sharing code in submissions?

Asking primarily due to the NIPS deadline. I have always submitted code with my submissions to all conferences before. However, with how good new AI agents are nowadays, I wanted to gather feedback on whether we should stop sharing code in submissions and publish them after acceptance. However, what if the submission focuses on other parts of reproducibility, like the algorithm mentioned, the hyperparameter tuning protocol mentioned, as well as the number of repetitions?

Based on my prior experience, reviewers do not really look at code. But they seem to crib if it is not provided. But I saw a couple of my labmates not share code in the ICML cycle, and the reviewers did not crib about it. After hearing some horror stories of ideas being stolen based on code on this sub, is it reasonable not to submit code for submissions? I am simply curious.

submitted by /u/Massive-Bobcat-5363
[link] [comments]

Read on the original site

Open the publisher's page for the full experience

View original article

Tagged with

#no-code spreadsheet solutions#cloud-based spreadsheet applications#financial modeling with spreadsheets#rows.com#natural language processing for spreadsheets#generative AI for data analysis#Excel alternatives for data analysis#NIPS#ML Conferences#code submission#reproducibility#algorithm#hyperparameter tuning#ICML#peer review#feedback#submission process#reviewers#repetitions#acceptance
Submitting to top ML Conferences without Sharing code [D] | Beyond Market Intelligence