Qwen 0.8B Runs on Old S10E at 12 t/s

🔑 Enhanced Key Takeaways

• •Qwen3.5-0.8B is part of Alibaba's newly released compact model series (0.8B, 2B, 4B, 9B) announced on March 2, 2026, all in dense format with open-weight licensing under Apache 2.0[1][2]
• •The model natively supports multimodal processing (text, images, and video) with 262K context window and 201 language coverage, achieving MathVista 62.2 and OCRBench 74.5 benchmarks despite sub-1B parameter count[1]
• •Memory efficiency enables deployment across diverse edge devices: ~1.6GB VRAM at full precision (BF16), ~0.8GB at 8-bit quantization, and ~0.5GB at 4-bit quantization for phone and Raspberry Pi deployment[1]

🛠️ Technical Deep Dive

• •Architecture: Gated DeltaNet + Gated Attention hybrid (3:1 ratio) with 0.8B total parameters, all dense (no mixture-of-experts)[1]
• •Multimodal capabilities: Processes screenshots, documents, and basic video understanding natively within a single model[1]
• •Deployment flexibility: Available as base model (Qwen3.5-0.8B-Base) and seven quantized variants across HuggingFace and ModelScope[1]
• •Context window: 262K tokens, enabling long-form document and conversation processing[1]
• •Language support: Covers 201 languages for multilingual inference[1]

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline