Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
ByteDance has released SeedRealtime, an audio-video full-duplex foundation model designed for more natural real-time interaction. The same roundup also reports JD.com’s open-source JoyAI-Video-Edit model, which supports real-time interactive video editing.
钛媒体 · 44d ago
ByteDance has launched SeedRealtime, a full-duplex AI model designed for continuous conversations. It unifies audio, video, and text while supporting proactive responses and more natural conversational timing.
TestingCatalog · 45d ago
Alibaba has officially launched Qwen-Image-3.0, the third generation of its image generation foundation model. The model features enhanced capabilities including 4.5k token input support, precise 10px text rendering, and native support for 12 languages.
36氪 · 60d ago
Thinking Machines Lab has launched Inkling, a massive 975-billion-parameter open source model. The model is specifically designed to process and understand both video and audio data.
Wired AI · 66d ago
Alibaba has launched Qwen-Audio-3.0-Realtime, a new real-time audio large model. The update introduces four significant functional enhancements focused on speed and intelligence.
量子位 · 66d ago
SenseTime has released SenseNova-Vision, a unified foundation model capable of handling multiple vision tasks like object detection and 3D reconstruction. It replaces the need for separate specialist models by integrating these capabilities into one system.
TechNode · 67d ago
MedRealMM is a large-scale, real-world multimodal benchmark derived from authentic Chinese clinical consultations. It evaluates LLMs on their ability to handle text-image medical data, highlighting safety and reasoning gaps compared to human physicians.
ArXiv AI · 68d ago
Meta has launched Muse Spark 1.1, featuring a public API preview for developers. The update enhances AI agent capabilities and streamlines multimodal workflows.
TestingCatalog · 72d ago
ByteDance has unveiled Seedream 5.0 Pro, a multimodal image-creation model. It features enhanced reasoning capabilities, precise editing tools, and multilingual support.
TestingCatalog · 72d ago
Meta is reportedly developing smart glasses equipped with 'super sensing' AI that continuously monitors the user's environment. The system aims to feed real-time data to an AI agent to provide proactive assistance.
Digital Trends · 73d ago
This article provides a comprehensive evaluation of six top-tier AI video generation models, including Seedance 2.0, Kling 3.0, and Sora 2.0. It analyzes their core strengths, use cases, and limitations for both individual creators and enterprise users.
36氪 · 73d ago
Meta has introduced its new Muse Image model, the first release from its Superintelligence Labs division. The model powers image generation across Meta's ecosystem, including Instagram, WhatsApp, and the Meta AI app, with plans to expand to Facebook and Messenger.
The Verge · 73d ago
Google DeepMind has introduced new capabilities with Nano Banana 2 Lite and Gemini Omni Flash. These tools are designed to help developers build more efficient and responsive AI applications.
DeepMind Blog · 81d ago
MKG-RAG-Bench is a new cross-domain benchmark designed to evaluate retrieval performance in multimodal knowledge graph-augmented generation. It addresses the critical bottleneck of heterogeneous data alignment by providing a curated dataset for testing retrieval and downstream generation quality.
ArXiv AI · 84d ago
This research paper analyzes the limitations of current multimodal LLM benchmarks, which often fail to assess cross-modal integration. It highlights the need for better metrics in areas like temporal-spatial coherence and physical world understanding.
ArXiv AI · 85d ago
NaviGen introduces a novel framework that transforms user interaction history into executable instructions for image and video generation. By using a dual-identifier representation and a two-stage SFT+RL pipeline, it bridges the gap between vague user intent and high-fidelity multimodal output.
ArXiv AI · 86d ago
ReMMD is a new framework designed to handle complex, multilingual, and multi-image misinformation. It utilizes an agentic approach with persistent memory to decompose posts and verify veracity more efficiently than existing methods.
ArXiv AI · 87d ago
CaVe-VLM-CoT is a new agentic-RAG framework designed to reduce hallucinations in Vision-Language Models through a five-stage closed-loop verification pipeline. It introduces CaVeScore, a comprehensive metric for evaluating retrieval quality, citation faithfulness, and cross-modal grounding.
ArXiv AI · 93d ago
Mel AI has released a demo of video-native AI characters capable of real-time speech, facial expressions, and environmental awareness. The system reacts to the user's camera context, marking a shift from text-based chat to immersive video interaction.
Reddit r/MachineLearning · 94d ago
Apple is reportedly developing AirPods with integrated cameras to provide 'visual context' for AI-powered features like Siri. These devices are expected to launch in 2027 and are currently being tested with iOS 28.
The Verge · 95d ago
Apple is developing new AirPods featuring built-in cameras, slated for a 2027 release. The product is intended to serve as a key device in Apple's broader AI hardware strategy.
Bloomberg Technology · 95d ago
Google DeepMind's Gemma 4 model family is now available on Amazon Bedrock. This release includes three instruction-tuned variants featuring dense and mixture-of-experts architectures with multimodal capabilities.
AWS Machine Learning Blog · 96d ago
Orchestra-o1 is a new framework designed for multi-agent systems to handle heterogeneous modalities like text, image, audio, and video. It improves task decomposition and collaboration, achieving state-of-the-art performance on the OmniGAIA benchmark.
ArXiv AI · 96d ago
Meta's smart glasses are being repurposed to provide visual assistance to blind veterans. This application demonstrates a positive use case for wearable AI technology in accessibility.
Digital Trends · 99d ago
Major tech companies including Meta, Google, Samsung, Apple, and Amazon are racing to integrate multimodal AI and cameras into wearable smart glasses. This trend signals a shift toward all-day AI interaction, though it faces significant public privacy concerns.
Computerworld · 99d ago
This article provides a hands-on review of Claude's latest model, Fable 5. It highlights significant improvements in visual reasoning, specifically noting the model's ability to accurately count fingers in generated images.
Ifanr (爱范儿) · 101d ago
NVIDIA introduces Nemotron 3.5 Content Safety, a new tool designed to provide customizable, multimodal safety guardrails for enterprise AI applications. It enables organizations to enforce specific safety policies across text and visual inputs to ensure reliable deployment.
Hugging Face Blog · 107d ago
VAMPS is a new multimodal benchmark featuring 1,168 questions designed to test whether LLMs can effectively use visualization tools to solve complex algebra and calculus problems. The study reveals that current models often struggle to integrate tool-generated plots, frequently performing better with direct analytical reasoning.
ArXiv AI · 107d ago
NetEase Youdao's LobsterAI has integrated a suite of advanced generative models, including Seedream, Seedance, HappyHorse, and MiniMax-Hailuo. This update significantly expands the platform's capabilities in image and video synthesis.
36氪 · 110d ago
Vercel has integrated MiniMax M3, a multimodal model featuring a 1M-token context window, into its AI Gateway. This integration allows developers to leverage advanced agentic capabilities and native multimodality through a unified API.
Vercel News · 111d ago