Some Ethical Issues in the Review Process of Machine Learning Conferences

06/01/2021
by   Alessio Russo, et al.
0

Recent successes in the Machine Learning community have led to a steep increase in the number of papers submitted to conferences. This increase made more prominent some of the issues that affect the current review process used by these conferences. The review process has several issues that may undermine the nature of scientific research, which is of being fully objective, apolitical, unbiased and free of misconduct (such as plagiarism, cheating, improper influence, and other improprieties). In this work, we study the problem of reviewers' recruitment, infringements of the double-blind process, fraudulent behaviors, biases in numerical ratings, and the appendix phenomenon (i.e., the fact that it is becoming more common to publish results in the appendix section of a paper). For each of these problems, we provide a short description and possible solutions. The goal of this work is to raise awareness in the Machine Learning community regarding these issues.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/04/2018

Case for the double-blind peer review

Peer review is a process designed to produce a fair assessment of resear...
research
11/07/2021

Proposing an Interactive Audit Pipeline for Visual Privacy Research

In an ideal world, deployed machine learning models will enhance our soc...
research
05/04/2021

A Review on Oracle Issues in Machine Learning

Machine learning contrasts with traditional software development in that...
research
11/14/2022

Cracking Double-Blind Review: Authorship Attribution with Deep Learning

Double-blind peer review is considered a pillar of academic research bec...
research
06/05/2023

Has the Machine Learning Review Process Become More Arbitrary as the Field Has Grown? The NeurIPS 2021 Consistency Experiment

We present the NeurIPS 2021 consistency experiment, a larger-scale varia...
research
10/11/2020

An Open Review of OpenReview: A Critical Analysis of the Machine Learning Conference Review Process

Mainstream machine learning conferences have seen a dramatic increase in...
research
04/16/2019

HARK Side of Deep Learning -- From Grad Student Descent to Automated Machine Learning

Recent advancements in machine learning research, i.e., deep learning, i...

Please sign up or login with your details

Forgot password? Click here to reset