๐Ÿค–Stalecollected in 20m

ICML Reviewer Drops Score After Rebuttal

PostLinkedIn
๐Ÿค–Read original on Reddit r/MachineLearning

๐Ÿ’กICML score flip post-rebuttal: rejection signal or normal? Key for submitters.

โšก 30-Second TL;DR

What Changed

Reviewer acknowledged rebuttal and upped score to 5(3)

Why It Matters

Reveals score volatility in ICML reviews, urging researchers not to over-rely on rebuttal gains before final decisions.

What To Do Next

Check OpenReview frequently for ICML score updates during AC discussions.

Who should care:Researchers & Academics

๐Ÿง  Deep Insight

AI-generated analysis for this event.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขICML 2026 utilizes a multi-stage review process where Area Chairs (ACs) have the authority to override or adjust reviewer scores based on private discussions, often leading to score volatility post-rebuttal.
  • โ€ขThe 'confidence' score (the number in parentheses) is a critical weighting factor in the final decision-making process, meaning a score drop from a high-confidence reviewer carries significantly more weight than a change from a low-confidence reviewer.
  • โ€ขCommunity discourse on platforms like OpenReview and Reddit suggests that 'score sniping' or late-stage score adjustments by ACs are a recurring point of contention in top-tier AI conference peer review cycles.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

ICML will implement stricter transparency requirements for AC score adjustments.
Increasing community pressure regarding the lack of visibility into post-rebuttal score changes is likely to force policy updates in future conference cycles.
The reliance on numerical scores for paper acceptance will decrease.
The volatility of scores during the AC discussion phase highlights the inadequacy of simple averaging as a proxy for scientific merit, prompting a shift toward more qualitative assessment models.

โณ Timeline

2026-01
ICML 2026 paper submission deadline.
2026-03
Initial reviewer scores released to authors.
2026-04
Rebuttal phase concluded and AC discussion period initiated.
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ†—