๐คReddit r/MachineLearningโขStalecollected in 22m
Prompts for LLM ML Paper Review
#llm-prompts#paper-review#conferencesllm-paper-review-promptscvpreccviclr
๐กLLM prompts to polish your CVPR/ICLR paper โ catch errors before submission!
โก 30-Second TL;DR
What Changed
LLM prompts to self-review ML/CV manuscripts
Why It Matters
Improves paper quality for conference submissions, helping researchers avoid minor errors via AI assistance.
What To Do Next
Check Reddit comments for shared LLM prompts or test Claude/GPT on your CVPR draft.
Who should care:Researchers & Academics
Key Points
- โขLLM prompts to self-review ML/CV manuscripts
- โขTarget conferences: CVPR, ECCV, ICLR
- โขFocus on small mistakes affecting author credibility
๐ง Deep Insight
Background and context from public sources โ not the original article. 9 sources cited.
๐ Enhanced Key Takeaways
- โขMajor conferences have implemented explicit LLM usage policies: CVPR 2026 prohibits LLMs entirely in the review process, while ICLR 2026 permits LLM assistance for grammar and clarity but mandates disclosure and holds reviewers accountable for all content[2][6]
- โขResearch demonstrates that hidden prompt injections embedded as invisible text in PDF submissions can achieve up to 100% acceptance rates when LLMs generate reviews, representing a critical integrity vulnerability in peer review systems[3]
- โขLLM-generated reviews exhibit systematic positive bias (>95% acceptance in many models) and are measurably less effective at identifying weaknesses compared to human reviewers, though they perform comparably on identifying strengths[3]
- โขAdvanced prompting techniques like Retrieval-Augmented Generation (RAG) enable LLMs to process full papers rather than abstracts alone, improving review quality by reducing token limitations and hallucinations through external knowledge retrieval[1]
๐ ๏ธ Technical Deep Dive
Prompting Strategies
- โขFew-shot prompting: Provides example system prompts and responses to steer models toward consistent categorization styles
- โขTree of Thoughts (ToT): Encourages LLMs to maintain intermediate reasoning steps through deliberate self-evaluation of problem-solving progress
- โขRetrieval-Augmented Generation (RAG): Integrates external knowledge sources via built-in retrieval components to mitigate hallucination and outdated knowledge; only method capable of processing full papers without token restrictions
Evaluation Findings
- โขLlama 3.3 and 5 open-source LLMs tested across 200 papers with hyperparameter optimization for accuracy
- โขTesting conditions included three affiliation scenarios: no affiliation, prestigious affiliation, and less prestigious affiliation to assess bias
- โขPrompt injection effectiveness: simple invisible text injections (white-on-white or tiny fonts in LaTeX) successfully parsed by PDF readers and chat interfaces
Architecture Context
LLMs operate on Transformer architecture with self-attention mechanisms enabling models to weigh word importance and handle long-range dependencies in text[4]
๐ฎ Future ImplicationsAI analysis grounded in cited sources
Mandatory LLM disclosure in peer review will become standard across major ML conferences
ICLR 2026 and CVPR 2026 have already established divergent policies, suggesting industry-wide standardization efforts will accelerate to prevent review integrity violations.
Prompt injection attacks will drive adoption of PDF parsing safeguards and submission validation systems
Demonstrated 100% success rates of hidden prompt injections create immediate incentive for conferences to implement technical countermeasures in submission pipelines.
RAG-enhanced LLM review systems will become preferred over abstract-only approaches for manuscript evaluation
RAG's ability to process full papers while reducing hallucinations addresses the primary limitation preventing LLM-assisted review adoption at scale.
โณ Timeline
2025-08
ICLR 2026 publishes LLM usage policies permitting grammar assistance with mandatory disclosure; establishes reviewer accountability framework
2025-09
Research demonstrates prompt injection attacks achieving 100% acceptance rates on LLM-generated reviews of ICLR 2024 papers
2026-01
CVPR 2026 releases strict reviewer guidelines prohibiting all LLM use in review generation, citing content responsibility and hallucination risks
2026-02
JMIR AI publishes comprehensive evaluation of LLMs for organ transplantation peer review, comparing RAG, few-shot, and ToT prompting strategies
๐ Sources (9)
Factual claims are grounded in the sources below. Forward-looking analysis is AI-generated interpretation.
- ai.jmir.org โ E84322
- blog.iclr.cc โ Policies on Large Language Model Usage at Iclr 2026
- arXiv โ 2509
- hatchworks.com โ Large Language Models Guide
- openreview.net โ Forum
- cvpr.thecvf.com โ Reviewerguidelines
- youssefh.substack.com โ Important LLM Papers for the Week 504
- GitHub โ AI Review Prompt
- iclr.pangram.com โ Reviews
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/MachineLearning โ
This is a summary, not the original. Read the source, or get the weekly briefing.
Weekly AI briefing
One email a week. Unsubscribe anytime.