Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
Hugging Face blog details training and finetuning multimodal embedding and reranker models using Sentence Transformers. It covers handling text and images for advanced retrieval tasks.
Hugging Face Blog · 156d ago
Former Google DeepMind researcher Andrew Dai is launching a new startup focused on visual AI. He criticizes big lab AI models, saying they possess the intelligence of a 3-year-old when processing visual prompts.
Bloomberg Technology · 162d ago
Universal Robots and Scale AI jointly developed the UR AI Trainer, an AI training system. It uses a training cell where robots imitate human actions to acquire multimodal data.
ITmedia AI+ (日本) · 165d ago
NetEase Youdao launched Youdao Baoku, China's first localized AI knowledge base on April 7. It acts as an AI research assistant for deep knowledge understanding and restructuring.
36氪 · 165d ago
Meituan advances native multimodal by treating images and speech as tokens for prediction. Approach claims discrete vision has no performance ceiling.
量子位 · 168d ago
Wanxing Tech's Wanxing Juchang platform relaunched on April 2 with full Seedance 2.0 model capabilities. It enables industrial workflows for AI real-person dramas, 2D/3D animations, and image-to-video, using multimodal inputs for director-level control.
36氪 · 170d ago
Meta researchers unveiled TRIBE v2, a foundation model predicting human brain activity from video, audio, and language stimuli. The paper 'A foundation model of vision, audition, and language for in-silico neuroscience' explores its potential.
ITmedia AI+ (日本) · 170d ago
Hugging Face blog features 'Falcon Perception' as a new entry. This appears to signal the launch of a perception-focused AI model or feature from the Falcon series.
Hugging Face Blog · 170d ago
Multimodal embeddings enable AI systems to search and reason across text, images, audio, and video natively. The Weaviate blog explains key intuitions and provides three practical RAG implementations using Weaviate and Gemini.
Weaviate Blog · 171d ago
Zhixiang Future CTO Yao Ting explains AI's evolution from content generation to end-to-end task completion via multimodal world models and agent systems. The company, spun from Microsoft and JD.com expertise, open-sourced HiDream-I1 and launched tools like Vivago for creators.
雷峰网 · 172d ago
Meta is testing multiple Avocado AI model variants, including Avocado 9B and Avocado Mango Agent. These incorporate multimodal features.
TestingCatalog · 173d ago
Claw is launched as the world's first multimodal creative marketing tool. It equips independent creators with professional-grade capabilities.
Ifanr (爱范儿) · 175d ago
Qiu Xipeng's new company announces hundreds of millions RMB in angel funding. Focuses on evolving from tokens to 'ciyuan' as base units in multimodal AI era.
量子位 · 176d ago
Memory Bear AI introduces a memory-centered framework for multimodal affective intelligence, treating emotions as evolving variables in a structured memory system. Multimodal signals are converted into Emotion Memory Units (EMUs) for persistent storage, retrieval, and updating across interactions.
ArXiv AI · 178d ago
Apple is testing a dedicated Siri app resembling a chatbot. Users can manage conversations, upload files, and switch seamlessly between voice and text inputs in one interface.
Digital Trends · 178d ago
Tencent’s WeChat has launched the ClawBot plugin, compatible with the open-source AI agent framework OpenClaw. Users can connect it via Settings and Plugins by scanning a QR code or copying a command after updating the app.
TechNode · 179d ago
Developers behind MiMo-V2-Pro, Omni, and TTS models promise to open-source them once stable enough. Announcement comes from an X post by _LuoFuli.
Reddit r/LocalLLaMA · 184d ago
Character.AI introduces Imagine Gallery as a dedicated space for visuals created with the Imagine feature. Imagine transforms conversations into dramatic scenes, surreal worlds, and unexpected moments, enhancing chat creativity.
Character.AI · 184d ago
PKU Peng Yuxin team’s TARA aligns multimodal representations with taxonomy knowledge for hierarchical visual recognition. Boosts HCA 3-6% on iNat21, strong on unknown species via TerraIncognita.
雷峰网 · 184d ago
Google integrates Gemini AI into Maps, launching 'Ask Maps' for conversational queries and 'Immersive Navigation' for enhanced guidance. These features empower one-sentence travel planning.
cnBeta (Full RSS) · 188d ago
Google integrates Gemini AI into Maps, enabling users to generate complete travel itineraries from a single sentence. Netizens claim this renders specialized vertical travel apps obsolete.
量子位 · 188d ago
OpenUtter is a headless Google Meet bot for OpenClaw agents. It provides live captions, transcripts, and screenshots without needing a browser window.
OpenClaw.report · 189d ago
Google announced Gemini-powered updates to Google Maps, introducing 'Ask Maps' for conversational searches handling complex conditions and 'Immersive Navigation' for intuitive 3D route guidance. Features include personalized suggestions based on user preferences and history, plus natural voice guidance to redefine navigation.
ITmedia AI+ (日本) · 190d ago
Google Maps is launching an AI-powered 'Ask Maps' feature for natural language queries. It also features an upgraded 'Immersive Navigation' experience.
TechCrunch AI · 190d ago
Zhou Chang stands behind both Alibaba's Qwen LLM and Seedance multimodal AI. His seven-year journey spans from Damoyuan Institute recruitment to leading Seed as multimodal top player.
钛媒体 · 190d ago
OpenAI plans to integrate Sora video generator into ChatGPT. Users will create short AI videos directly from the chat interface.
Digital Trends · 191d ago
Apple and OpenAI integrate Shazam into the ChatGPT app for direct song recognition in chats. Users can identify background music with one tap without switching apps.
cnBeta (Full RSS) · 192d ago
Researchers propose a reproducible framework to evaluate multimodal LLMs' reasoning on ECG signals by decomposing into Perception (pattern identification) and Deduction (clinical logic). Perception uses agentic code generation to verify temporal structures empirically.
ArXiv AI · 199d ago
Rokid Glasses overseas version receives major upgrade integrating four top AI models: Gemini, ChatGPT, DeepSeek, Tongyi Qianwen. First in industry to support Gemini on AI glasses.
36氪 · 200d ago
Qwen released Qwen 3.5 Small multimodal models in sizes 0.8B to 9B for on-device use. A demo runs the 0.8B variant locally in the browser using Transformers.js on WebGPU.
Reddit r/LocalLLaMA · 200d ago