Layer Duplication Tops Open LLM Leaderboard
Researcher duplicated 7 middle layers in Qwen2-72B without weight changes to top Open LLM Leaderboard; top 4 models today descend from it. Technique requires circuit-sized ~7-layer blocks. Developed on 2x 4090 GPUs; new models like Qwen3.5 variants coming.






