Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
Meituan released and fully open-sourced its native multimodal large model LongCat-Next and core component dNaViT visual tokenizer on March 27. It unifies image, speech, and text into discrete tokens, breaking language-centric architectures.
36氪 · 176d ago
Google has rolled out the 'Search Live' feature in Japan and all regions with AI mode enabled. Powered by Gemini 3.1 Flash Live, it enables real-time voice and camera interactions with improved audio nuance understanding and emotion-adapted responses.
ITmedia AI+ (日本) · 176d ago
ByteDance unveiled Dreamina Seedance 2.0, a new multimodal video generation model, now integrated into its CapCut video editing app. This expansion targets global creators amid OpenAI's Sora app closure.
cnBeta (Full RSS) · 177d ago
Google's TurboQuant reduces AI memory usage by 6 times, causing SanDisk and Micron stocks to drop. The piece analyzes software-hardware dynamics behind it.
钛媒体 · 177d ago
Google rolls out three Gemini AI features for Google TV: richer visual help for queries like sports scores and recipes, interactive deep dives on topics, and narrated sports briefs. These turn passive TV time into educational experiences.
Engadget · 179d ago
Hugging Face introduces Nemotron 3 Content Safety 4B, a 4 billion parameter model for advanced content moderation. It supports multimodal inputs like text and images, and handles multiple languages for global applicability.
Hugging Face Blog · 183d ago
Curated roundup of open-source multimodal tools: FlashMotion for fast video gen, Foundation 1 for music, GlyphPrinter for text rendering, and more like MatAnyone 2 and ViFeEdit. All weights/code available for local runs.
Reddit r/LocalLLaMA · 185d ago
Mistral AI has launched Forge, a platform enabling enterprises to train AI models with their internal data. It supports multimodal inputs and agent-first tuning for customized enterprise solutions.
TestingCatalog · 185d ago
Openrouter's stealth models Hunter Alpha and Healer Alpha are officially confirmed as MiMo V2 Pro and MiMo V2 Omni. Hunter Pro offers 1M context for text-only reasoning, while Healer Omni supports text+image with 262K context.
Reddit r/LocalLLaMA · 186d ago
OpenAI launched GPT-5.4 mini, making advanced capabilities available to ChatGPT Free and Go users via the 'Thinking' model selector. It outperforms GPT-5.0 mini in reasoning, multimodal understanding, and tool use while running over twice as fast.
Engadget · 186d ago
H Company released Holotron-12B, an open-source multimodal model developed with NVIDIA for computer-use agents. It matches Holo2/Qwen performance but offers 2x higher throughput.
Reddit r/LocalLLaMA · 186d ago
Chinese AI marketing firm Titanium Tech files for HK IPO after revenue surge to $130M in 9M2025 from $72M in 2023. AI solutions drive 90% revenue via multimodal models and automation, with 82%+ margins but $557M receivables and platform dependency risks.
虎嗅 · 187d ago
Anthropic has launched a beta feature in Claude for inline generation of tables, charts, and images within chat responses. Based on the September 2025 'Imagine with Claude' release, it's available to all users including free tier.
ITmedia AI+ (日本) · 191d ago
OpenAI's Sora video generator is reportedly integrating into ChatGPT as a built-in feature. Currently limited to its own website or app with lower popularity, this mirrors last year's image generation addition.
The Verge · 192d ago
New 4.5B param model ColQwen3.5-v1, based on Qwen3.5-4B with ColPali late-interaction, tops ViDoRe V1 at nDCG@5 0.917. Apache 2.0 on Hugging Face; v2 targets ViDoRe V3 SOTA.
Reddit r/MachineLearning · 192d ago
Google unveils its first native multimodal embedding model, unifying text, images, videos, and audio into a single embedding space. Dramatic demos show even lobsters 'understanding' screens.
量子位 · 192d ago
Google has launched the Gemini Embedding 2 model, a new multimodal embedding solution. It supports text, image, video, audio, and document embeddings in a unified vector space.
TestingCatalog · 193d ago
SenseTime has completely eliminated VE and VAE components in its multimodal models, removing all intermediate encoders for a streamlined architecture. Their new 2B parameter model dramatically outperforms traditional paradigms.
量子位 · 196d ago
Luma has unveiled UNI-1, a unified model for visual understanding and image generation. It merges text and image processing to handle reasoning tasks.
TestingCatalog · 197d ago
Luma has introduced Luma Agents, powered by its new 'Unified Intelligence' models. These agents coordinate multiple AI systems to generate end-to-end creative work across text, images, video, and audio.
TechCrunch AI · 198d ago
YuanLab.ai released the open-source Yuan3.0 Ultra multimodal foundation model. It integrates MoE architecture optimizations for training efficiency and targets enterprise tasks.
36氪 · 198d ago
Microsoft launched Phi-4-reasoning-vision-15B, a 15B-parameter open-weight multimodal model excelling in vision-language tasks, math/science reasoning, and GUI navigation. Trained on just 200B multimodal tokens—1/5 of rivals—it rivals larger models via superior data curation.
VentureBeat · 199d ago
Microsoft releases Phi-4-Reasoning-Vision-15B, a compact open-weight multimodal model using SigLIP-2 vision encoder and mid-fusion architecture. It supports chain-of-thought reasoning or direct inference for tasks like math, captioning, and GUI grounding.
Reddit r/LocalLLaMA · 199d ago
Anthropic rolls out Voice Mode in Claude Code. This adds voice capabilities to AI coding assistance.
TechCrunch AI · 200d ago
An uncensored version of the new Qwen3.5-4B model has been released in GGUF format with zero refusals out of 465 tests. It retains full capabilities, supports multimodal inputs, and offers various quants from 2.6GB to 7.9GB.
Reddit r/LocalLLaMA · 200d ago
Alibaba's Tongyi Qianwen open-sourced four small Qwen3.5 models: 0.8B, 2B, 4B, 9B. They inherit strong multimodal capabilities for edge devices to compact servers.
IT之家 · 201d ago
SleepLM introduces foundation models aligning multimodal polysomnography with natural language for sleep analysis. It curates the first large-scale sleep-text dataset from over 100K hours of data across 10K+ individuals.
ArXiv AI · 201d ago
A Reddit post details how to enable multimodal image understanding in Qwen 3.5 using llama.cpp via opencode. Users add a 'modalities' configuration to the opencode.json file specifying text and image inputs.
Reddit r/LocalLLaMA · 203d ago
Google announced Agentic Vision for Gemini 3 Flash, a new feature combining visual reasoning and code execution. It autonomously generates Python code to investigate images, boosting image understanding accuracy by 10%.
ITmedia AI+ (日本) · 204d ago
Gemini 3.1 Flash Image Preview (Nano Banana 2) is now live on AI Gateway, improving visual quality while keeping flash-tier speed and cost. It uses Google Image Search to ground images in real-world data and introduces configurable thinking levels (Minimal/High) for complex prompts.
Vercel News · 205d ago