Qwen3.5-9B-Longbook9-GDN32-x2
1. Layer replacement. The 8 full-attention layers listed above were replaced with GDN/linear-attention layers, each initialized from a...
1. Layer replacement. The 8 full-attention layers listed above were replaced with GDN/linear-attention layers, each initialized from a...