Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
Meta's smart glasses are being repurposed to provide visual assistance to blind veterans. This application demonstrates a positive use case for wearable AI technology in accessibility.
Digital Trends · 99d ago
Major tech companies including Meta, Google, Samsung, Apple, and Amazon are racing to integrate multimodal AI and cameras into wearable smart glasses. This trend signals a shift toward all-day AI interaction, though it faces significant public privacy concerns.
Computerworld · 99d ago
This article provides a hands-on review of Claude's latest model, Fable 5. It highlights significant improvements in visual reasoning, specifically noting the model's ability to accurately count fingers in generated images.
Ifanr (爱范儿) · 101d ago
NVIDIA introduces Nemotron 3.5 Content Safety, a new tool designed to provide customizable, multimodal safety guardrails for enterprise AI applications. It enables organizations to enforce specific safety policies across text and visual inputs to ensure reliable deployment.
Hugging Face Blog · 107d ago
VAMPS is a new multimodal benchmark featuring 1,168 questions designed to test whether LLMs can effectively use visualization tools to solve complex algebra and calculus problems. The study reveals that current models often struggle to integrate tool-generated plots, frequently performing better with direct analytical reasoning.
ArXiv AI · 107d ago
NetEase Youdao's LobsterAI has integrated a suite of advanced generative models, including Seedream, Seedance, HappyHorse, and MiniMax-Hailuo. This update significantly expands the platform's capabilities in image and video synthesis.
36氪 · 110d ago
Vercel has integrated MiniMax M3, a multimodal model featuring a 1M-token context window, into its AI Gateway. This integration allows developers to leverage advanced agentic capabilities and native multimodality through a unified API.
Vercel News · 111d ago
Kuaishou reported strong growth for its Kling AI business, with revenue exceeding 6.5 billion RMB in Q1 2026. The platform's video generation capabilities have expanded globally, reaching 42 countries and regions.
IT之家 · 115d ago
ByteDance has released Lance, a new open-source multimodal model designed to run locally on hardware with 40GB of VRAM. The model gained significant traction on Hugging Face shortly after its release.
Pandaily · 117d ago
ByteDance has open-sourced Lance, a lightweight multimodal AI model with 3 billion parameters. It is designed to handle image understanding, generation, and video tasks within a single, efficient architecture.
Pandaily · 120d ago
CapCut has announced a partnership with Google to integrate its creative editing tools directly into the Gemini application. This integration aims to create a more seamless and conversational workflow for image and video editing.
IT之家 · 121d ago
Qwen-code v0.16.0 introduces significant improvements to the CLI, including batch session deletion and ModelScope integration. The update also enhances subagent performance, adds multimodal support for Qwen3.6-35B-A3B, and improves MCP availability.
Qwen (GitHub Releases: qwen-code) · 121d ago
NetEase Youdao has upgraded its Ziyue LLM to version 4.0, introducing full-modal capabilities. The company has officially open-sourced its core multimodal and text-to-speech (TTS) models.
36氪 · 121d ago
HiDream.ai has launched HiDream-O1-Image-Pro, a 200B+ parameter image model built on the Unified Transformer (UiT) architecture. The model achieves SOTA performance in text rendering, image generation, and multi-task editing by integrating images, text, and conditions into a shared latent space.
雷峰网 · 121d ago
Andrew Dai, a core contributor to Google's Gemini and PaLM, has left Google to found Elorian AI. The startup focuses on multi-modal visual reasoning models, moving beyond pure LLM architectures.
虎嗅 · 122d ago
Google and Samsung are collaborating with Warby Parker and Gentle Monster to launch AI-powered smart glasses this autumn. The devices will feature voice-based interaction with Google's Gemini AI, with advanced display models expected by 2027.
36氪 · 122d ago
Google's Gemini app is receiving a significant update, including cinematic video generation and morning briefing capabilities. It also features a 24/7 agent designed to handle digital chores automatically.
Digital Trends · 123d ago
Shanghai Jiao Tong University and the Qwen team introduced CodePercept, a paradigm that uses executable code as a 'second language' to improve visual perception in STEM tasks. By training models to generate code that reproduces images, the system overcomes the ambiguity of natural language descriptions.
雷峰网 · 123d ago
TTE-Flash introduces 'latent think tokens' to replace explicit Chain-of-Thought generation, significantly reducing computational overhead for multimodal embeddings. The model achieves superior performance on the MMEB-v2 benchmark while maintaining constant inference costs.
ArXiv AI · 123d ago
Alibaba has launched the Qwen 3.7 Max preview, marking a significant milestone in their model development. The release demonstrates industry-leading capabilities in both text and vision domains.
量子位 · 123d ago
Ricoh has developed a multimodal large language model with reasoning capabilities under the GENIAC project. The lightweight model is now available for free on Hugging Face.
ITmedia AI+ (日本) · 127d ago
SenseTime has launched SenseNova U1, an open-source model featuring a native unified architecture. It integrates understanding and generation into a single representation space, moving away from traditional stitching methods.
Pandaily · 127d ago
Thinking Machines, founded by ex-OpenAI leaders Mira Murati and John Schulman, unveiled a research preview of 'interaction models' for near-real-time multimodal voice and video conversations. These models shift from turn-based AI to full-duplex processing, handling inputs and outputs simultaneously in 200ms chunks.
VentureBeat · 130d ago
Thinking Machines, founded by former OpenAI CTO Mira Murati, announced 'interaction models' enabling natural human-AI collaboration. These models process continuous audio, video, and text inputs in real-time, thinking, responding, and acting dynamically.
The Verge · 130d ago
Guangzhou AI office released 2026 work points focusing on industrial foundations. Strengthens smart computing via tiered data/compute center planning per national policy.
36氪 · 131d ago
Researchers developed a psychometric framework to assess generative AI cognitive profiles against human norms, revealing top performance in verbal and working memory but failures in perceptual reasoning. The AIQ Benchmark tracks evolution across six generations and two model families, showing asymmetric gains with language bias over visual tasks.
ArXiv AI · 131d ago
OpenAI has released three new AI voice models to unlock a new class of voice applications for developers. These models support advanced capabilities like deep reasoning, translation, and transcription.
TechRadar AI · 134d ago
PRISM introduces a framework that couples VLM perception and LLM decision-making via a dynamic question-answer pipeline. The LLM critiques VLM descriptions, probes with goal-oriented questions, and synthesizes task-driven scene understanding.
ArXiv AI · 134d ago
Pull request #22493 adds support for Xiaomi's Mimo v2.5 Sparse MoE model in llama.cpp. The 310B total parameter model activates 15B params, supports 1M token context, and handles text, image, video, audio modalities.
Reddit r/LocalLLaMA · 135d ago
ByteDance upgraded Doubao-Seed-2.0-lite, the first full-modality model in Doubao family, enabling native unified understanding of video, images, audio, and text. It achieves SOTA in visual/audio benchmarks, surpassing Gemini-3.1-Pro, with boosts in Agent, Coding, and GUI capabilities.
IT之家 · 136d ago