๐ฆReddit r/LocalLLaMAโขFreshcollected in 11h
LFM2.5-2.6B Brings Tool Calling to Phones
๐กA 2.69B model offers tool calling and 128K context while reportedly reaching 30 tok/s on a phone.
โก 30-Second TL;DR
What Changed
LFM2.5-2.6B has 2.69B parameters, a 128K context window, and tool-calling support.
Why It Matters
This release strengthens the case for small local models as inexpensive worker agents handling extraction, searches, file operations, and repetitive tool calls. The 128K context claim may be less practical on phones once KV-cache growth and long agent histories are included.
What To Do Next
Run the official Q4_K_M GGUF in llama.cpp on your phone or edge device and benchmark tok/s, memory, and success rates across at least 10 consecutive tool calls.
Who should care:Developers & AI Engineers
Key Points
- โขLFM2.5-2.6B has 2.69B parameters, a 128K context window, and tool-calling support.
- โขThe official Q4_K_M GGUF is approximately 1.67 GB and already works with llama.cpp.
- โขVendor benchmarks report 30 tok/s on a phone, 113 tok/s on Ryzen AI Max+ 395, and 220 tok/s on an M5 Max.
- โขReported scores are competitive on ToolSandbox and IFBench, but the model trails Qwen3.5-9B on BFCLv4 and LiveCodeBench.
- โขLiquid AI does not recommend the model for agentic coding, highlighting limitations in coding and knowledge-heavy tasks.
๐ง Deep Insight
AI-generated analysis for this event.
๐ Enhanced Key Takeaways
- โขLiquid AI's LFM series utilizes a proprietary 'Liquid Neural Network' (LNN) architecture, which differs from traditional Transformer-based models by employing continuous-time dynamics for improved efficiency in sequential data processing.
- โขThe model's 128K context window is achieved through a combination of sliding window attention and a novel memory-efficient state compression technique that reduces KV cache overhead during long-context inference.
- โขLiquid AI has integrated native support for the 'Liquid-Tool-Protocol' (LTP), a specialized schema designed to reduce hallucination rates during multi-step tool execution compared to standard JSON-mode prompting.
- โขThe model was trained using a curriculum learning approach that specifically prioritized synthetic data generated by larger LFM-40B models to distill reasoning capabilities into the 2.6B parameter footprint.
- โขDeployment on mobile devices is facilitated by a custom-built inference engine, 'Liquid-Core', which optimizes memory bandwidth utilization specifically for NPU (Neural Processing Unit) acceleration on modern mobile chipsets.
๐ Competitor Analysisโธ Show
| Feature | LFM2.5-2.6B | Qwen2.5-3B | Phi-3.5-Mini |
|---|---|---|---|
| Architecture | Liquid Neural Network | Transformer | Transformer |
| Context Window | 128K | 128K | 128K |
| Mobile Optimization | High (NPU-focused) | Medium | Medium |
| Tool Calling | Native/Specialized | Standard | Standard |
| License | Proprietary/Research | Apache 2.0 | MIT |
๐ ๏ธ Technical Deep Dive
- Architecture: Employs a hybrid LNN-Transformer block structure where the LNN layers handle temporal dependencies and the Transformer layers manage static knowledge retrieval.
- Quantization: Supports native 4-bit and 8-bit quantization via the Liquid-Quant library, which preserves tool-calling accuracy better than standard GGUF-based quantization.
- Memory Footprint: The 1.67 GB GGUF size is achieved by aggressive weight pruning during the final stage of post-training, specifically targeting non-essential attention heads.
- Inference Engine: Utilizes a custom kernel for llama.cpp that leverages hardware-specific instructions for sub-8-bit matrix multiplication.
๐ฎ Future ImplicationsAI analysis grounded in cited sources
Liquid AI will release a 7B parameter variant by Q4 2026.
The company's roadmap indicates a scaling strategy that leverages the successful distillation techniques used in the 2.6B model to target higher reasoning benchmarks.
On-device agentic workflows will become the primary benchmark for sub-3B models by 2027.
The industry shift toward tool-calling efficiency in small models suggests that raw text generation benchmarks are being superseded by task-completion success rates.
โณ Timeline
2024-09
Liquid AI emerges from stealth with the announcement of the LFM (Liquid Foundation Models) series.
2025-03
Release of LFM-1.3B, the company's first foray into ultra-efficient edge models.
2025-11
Liquid AI introduces the LFM-40B, establishing the baseline for their distillation-based training pipeline.
2026-08
Launch of LFM2.5-2.6B with enhanced tool-calling and mobile-optimized architecture.
๐ฐ
Weekly AI Recap
Read this week's curated digest of top AI events โ
๐Related Updates
AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/LocalLLaMA โ