🤖Reddit r/MachineLearning•Mar 18, 2026Stalecollected in 19m

ICML Rejects Papers for LLM Review Use

Post LinkedIn

🤖Read original on Reddit r/MachineLearning

#conference-policy #llm-detection #academic-integrityicmlicml llm

💡ICML's LLM ban hits submitters hard—know the rules before submitting

⚡ 30-Second TL;DR

What Changed

Reviewers agreed to no-LLM use but detected using LLMs

Why It Matters

This enforcement strengthens academic integrity in ML conferences but may deter participation amid detection inaccuracies. Researchers face higher scrutiny on tool usage.

What To Do Next

Check ICML submission guidelines and avoid LLMs in future reviews.

Who should care:Researchers & Academics

Key Points

•Reviewers agreed to no-LLM use but detected using LLMs
•All their submitted papers rejected by ICML
•First major conference taking harsh action on LLM-generated reviews
•Concerns about precision of AI detection tools

🧠 Deep Insight

Web-grounded analysis with 7 cited sources.

🔑 Enhanced Key Takeaways

•ICML 2026 implemented a dual-policy framework for reviewer LLM use: Policy A (Conservative) prohibits all LLM use in reviewing, while Policy B (Permissive) allows LLMs for understanding papers and polishing reviews but forbids delegating judgment to LLMs[3]. Reviewers were assigned to specific policies and violations constitute academic integrity breaches with desk-rejection consequences[3][4].
•ICML deployed automated prompt-injection detection systems to identify authors attempting to manipulate LLM reviewers through invisible text insertion, with an update on February 14, 2026 clarifying that prompts designed to detect LLM reviewer use are permitted[1][4].
•The conference strengthened concurrent submission policies requiring authors with multiple ICML 2026 submissions to cite and discuss related concurrent work in paper bodies, with violations resulting in cascading desk rejections of all submissions by violating authors[5].
•ICLR 2026 established parallel enforcement mechanisms, desk-rejecting papers with extensive undisclosed LLM usage and papers containing hallucinated references, while also penalizing reviewers who post LLM-generated or low-quality reviews through desk rejection of their own submissions[2].

🔮 Future ImplicationsAI analysis grounded in cited sources

Dual-policy frameworks may become industry standard for balancing LLM utility with research integrity

Both ICML and ICLR adopted tiered policies rather than blanket bans, suggesting conferences recognize selective LLM use as inevitable and are developing graduated enforcement rather than prohibition[3][2].

Automated detection systems will face precision-recall tradeoffs in identifying LLM-assisted reviews versus legitimate tool use

ICML's prompt-injection detectors and LLM-generated content identification require distinguishing malicious use from inadvertent LLM exposure in standard tools like grammar checkers[4][3].

Author self-ranking integration may reduce reviewer collusion in LLM-assisted review scenarios

ICML flagged papers with large discrepancies between reviewer scores and author self-rankings to identify potential coordinated low-quality reviews[5].

⏳ Timeline

2025-11

ICLR 2026 announces LLM-generated paper and review policies, establishing desk-rejection protocols for extensive undisclosed LLM usage and hallucinated content

2026-01

ICML 2026 submission deadline (January 28) passes; conference introduces dual LLM reviewing policies (Conservative and Permissive) with assigned reviewer compliance requirements

2026-02

ICML updates prompt-injection policy (February 14) to permit prompts designed to detect LLM reviewer use while maintaining ban on author-side prompt injection

2026-03

ICML 2026 enforces cascading desk rejections for peer-review integrity violations including LLM misuse, concurrent submission abuse, and low-quality AI-generated content