SetupAI
繁
SourceStalecollected in 17h

Ling 3.0 Tiny Lands on AI Gateway

Read original on Vercel News
#mixture-of-experts#function-calling#prompt-caching#long-context

Try a 1.3B-active-parameter agent model with 256K context and function calling for free on AI Gateway.

30-Second TL;DR

What Changed

Available on AI Gateway as inclusionai/ling-3.0-tiny-free until August 13, then changing to inclusionai/ling-3.0-tiny.

Why It Matters

The release gives developers access to a relatively compact model with a very long context window and agent-oriented capabilities through a unified gateway. Its temporary free availability lowers the cost of testing agent workflows, routing rules, retries, and failover configurations.

What To Do Next

Test inclusionai/ling-3.0-tiny-free in the AI Gateway playground before August 13, focusing on long-context agent calls and native function execution.

Who should care:Developers & AI Engineers

Key Points

  • •Available on AI Gateway as inclusionai/ling-3.0-tiny-free until August 13, then changing to inclusionai/ling-3.0-tiny.
  • •Uses a mixture-of-experts architecture with 7.9B total parameters and approximately 1.3B active parameters per token.
  • •Supports a 256K-token context window, up to 32K output tokens, native function calling, and prompt caching.
  • •Can be tested in the AI SDK playground or selected for coding agents through the Vercel AI Gateway setup.

Deep Insight

AI-generated analysis for this event — not the original article.

Enhanced Key Takeaways

  • •Ling 3.0 Tiny is part of the broader 'Ling' model family developed by Ant Group, which emphasizes high-efficiency deployment for mobile and edge computing environments.
  • •The model utilizes a specialized distillation process from larger Ling 3.0 variants to maintain instruction-following capabilities despite the reduced active parameter count.
  • •Vercel's integration leverages the AI Gateway's caching layer to specifically optimize the 256K context window performance, reducing latency for repeated prompt segments.
  • •Ant Group has positioned this model as a direct competitor to other 'Tiny' or 'Edge' class models by focusing on low-memory footprint requirements for real-time agentic workflows.
  • •The model's native function calling is optimized for JSON-mode output, specifically designed to reduce token overhead when interacting with external APIs.

Competitor Analysis

Architecture
Ling 3.0 Tiny
MoE (1.3B Active)
Llama 3.2 1B
Dense
Qwen2.5-1.5B
Dense
Mistral NeMo 12B
Dense
Context Window
Ling 3.0 Tiny
256K
Llama 3.2 1B
128K
Qwen2.5-1.5B
32K
Mistral NeMo 12B
128K
Primary Use Case
Ling 3.0 Tiny
Edge Agents
Llama 3.2 1B
Mobile/Edge
Qwen2.5-1.5B
General Purpose
Mistral NeMo 12B
RAG/Reasoning
Pricing (Vercel)
Ling 3.0 Tiny
Free (Limited)
Llama 3.2 1B
Varies
Qwen2.5-1.5B
Varies
Mistral NeMo 12B
Varies

Technical Deep Dive

  • Architecture: Mixture-of-Experts (MoE) with 7.9B total parameters and 1.3B active parameters per token, enabling high throughput with lower compute requirements.
  • Context Window: Supports up to 256K tokens, utilizing a sliding window attention mechanism to manage memory efficiency.
  • Output Capacity: Supports up to 32K tokens for long-form generation, significantly higher than standard small-scale models.
  • Optimization: Features native prompt caching and function calling capabilities, reducing the need for external orchestration layers in agentic applications.

Future ImplicationsAI analysis grounded in cited sources

Ant Group will release a larger Ling 3.0 variant with over 50B parameters by Q4 2026.
The naming convention 'Tiny' implies a tiered release strategy common in model families, suggesting larger, more capable models are in the pipeline.
Vercel will expand AI Gateway support to include fine-tuned versions of Ling 3.0.
The current integration setup allows for model selection, and Vercel's platform roadmap consistently trends toward supporting custom-tuned model endpoints.

Timeline

2025-11
Ant Group announces the initial development of the Ling model series.
2026-03
Ling 2.0 is released with improved multi-turn conversation capabilities.
2026-07
Ant Group releases Ling 3.0 base model for enterprise partners.
2026-08
Ling 3.0 Tiny is integrated into Vercel AI Gateway.
Read original article on Vercel News

Weekly AI Recap

Read this week's curated digest of top AI events →

PostLinkedIn

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Vercel News ↗

This is a summary, not the original. Read the source, or get the weekly briefing.

The weekly digest

One email a week. Unsubscribe anytime.