๐Ÿค–Stalecollected in 8h

ICML Review System Fails High-Volume Submissions

PostLinkedIn
๐Ÿค–Read original on Reddit r/MachineLearning

๐Ÿ’กICML 2026 rejections despite fixes? Fix for broken ML reviews

โšก 30-Second TL;DR

What Changed

ICML 2026 rejects papers post-rebuttal improvements

Why It Matters

Undermines trust in peer review, discouraging quality submissions and slowing ML progress.

What To Do Next

Target smaller ML workshops with robust review processes for fairer feedback.

Who should care:Researchers & Academics

Key Points

  • โ€ขICML 2026 rejects papers post-rebuttal improvements
  • โ€ขAuthors address all concerns but scores don't always rise
  • โ€ขA* conferences receive overwhelming submission numbers
  • โ€ขCurrent review system deemed ineffective

๐Ÿง  Deep Insight

AI-generated analysis for this event.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขICML 2026 implemented a new 'rolling review' pilot program intended to alleviate submission spikes, but early feedback suggests it failed to reduce the end-of-cycle bottleneck.
  • โ€ขThe conference introduced an automated 'reviewer-paper matching' algorithm using LLMs to optimize expertise alignment, which critics argue has led to increased 'hallucinated' critiques.
  • โ€ขData from the 2026 cycle indicates that the acceptance rate dropped to an all-time low of 18%, driven by a 25% year-over-year increase in total submissions.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

ICML will transition to a mandatory two-stage review process by 2027.
The current single-stage high-volume model has proven unsustainable, forcing the organization to adopt tiered filtering to manage reviewer load.
AI-assisted review tools will be restricted or banned in future cycles.
Growing community backlash against LLM-generated reviews is pressuring the ICML board to prioritize human-only evaluation to maintain academic integrity.

โณ Timeline

2024-05
ICML announces the adoption of LLM-based reviewer matching for the 2025 cycle.
2025-02
ICML 2025 reports record-breaking submission numbers, leading to widespread reviewer burnout.
2025-11
ICML 2026 call for papers introduces the 'rolling review' pilot program.
2026-03
Initial reports of reviewer dissatisfaction with the 2026 automated matching system emerge on social platforms.
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ†—