LLM Layer Duplication Hits 50% Depth Danger Zone
Experiments duplicating transformer layers across 6 architectures reveal a universal 'danger zone' at 50-56% depth that destroys capabilities when duplicated. Optimal duplication boosts weak models like Hybrid 9B by 75% in coding tasks. Cross-model transplants fail; models need exactly one danger zone layer.






