Lemonade v10 Launches Linux NPU Support

🔑 Enhanced Key Takeaways

• •Lemonade Server uses FastFlowLM runtime for efficient LLM inference on AMD Ryzen AI XDNA 2 NPUs in Linux, enabling low-power and quiet operation compared to GPU setups.[2]
• •Prior to v10, Lemonade NPU support was Windows-only for AMD Ryzen AI 300 series via ONNX Runtime GenAI (OGA) engine, with Linux development tracked in GitHub issues starting April 2025.[1][3][4]
• •Lemonade configures multiple inference engines including OGA, llamacpp (Vulkan/ROCm), and FLM, adopted by entities like AMD, Stanford's Hazy Research, and Styrk AI.[4]

🛠️ Technical Deep Dive

• •Supports AMD Ryzen AI 300 series NPUs via FastFlowLM (FLM) engine on Linux; OGA engine for NPU on Windows only.[2][4]
• •GPU acceleration through llamacpp with Vulkan (all platforms), ROCm (selected AMD), Metal (Apple Silicon); CPU inference across all engines and platforms.[4]
• •Hybrid models like Llama-xLAM-2-8b-fc-r-Hybrid optimized for NPU + iGPU on Ryzen AI 300 series, fine-tuned for tool-calling.[3]
• •Get started guide at lemonade-server.ai/flm_npu_linux.html for running LLMs on XDNA 2 NPU.[2]

🔮 Future ImplicationsAI analysis grounded in cited sources

⏳ Timeline