LLM 回憶 vs 辨識研究？

🔑 增強重點摘要

• •Research indicates a 'recognition-recall gap' where LLMs exhibit higher performance on multiple-choice verification tasks compared to open-ended generation, often attributed to the difference between constrained decoding and unconstrained probabilistic sampling.
• •The phenomenon of 'refusal to reproduce' is frequently a result of Reinforcement Learning from Human Feedback (RLHF) and safety fine-tuning layers that prioritize copyright compliance over raw model knowledge, effectively masking the model's internal recall capabilities.
• •Emerging techniques like 'Retrieval-Augmented Generation (RAG) with Verification' demonstrate that separating the retrieval/recall phase from a secondary verification step significantly reduces hallucination rates compared to relying on internal weights alone.

🛠️ 技術深入

• •Logit bias and constrained decoding: Verification tasks often utilize logit manipulation to force the model to choose between specific tokens (e.g., True/False), which bypasses the entropy issues inherent in open-ended text generation.
• •Attention mechanism behavior: During recall, models rely on internal weight activations to reconstruct sequences; during verification, the model uses cross-attention to compare input tokens against internal representations, which is computationally more stable.
• •RLHF impact on output distribution: Safety alignment training often introduces a 'refusal' token bias that triggers when the model detects high-probability sequences associated with copyrighted training data, effectively suppressing recall even when the information is present in the latent space.

🔮 前景展望基於引用來源的 AI 分析