How Top ML Conferences Select Best Papers

🔑 Enhanced Key Takeaways

• •Major conferences like NeurIPS have increasingly adopted 'rebuttal-based' review processes where the author's response to reviewer critiques is explicitly weighted in the final decision for Oral/Spotlight status.
• •The 'Best Paper' selection process often involves a multi-stage nomination pipeline where Area Chairs (ACs) nominate papers, followed by a dedicated Best Paper Committee that performs independent verification of claims.
• •Recent transparency initiatives have led conferences like ICLR and NeurIPS to publish anonymized review histories, revealing that 'consensus' scores are often secondary to 'championing' by a single influential AC.
• •There is a documented shift toward 'Reproducibility Scores' as a formal metric, where papers with verified code and data artifacts receive higher priority for oral presentation slots.
• •Conflict of interest (COI) policies have become significantly more stringent, utilizing automated systems to detect institutional and co-author overlaps to prevent bias in the award selection process.

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline