Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
COMPASS is a new unified multimodal framework that improves fine-grained composition recognition and control. By using a shared expert token for both perception and generation, it enables precise layout control in image synthesis.
ArXiv AI · 81d ago
The joint venture established by major Japanese corporations has rebranded to 'Noetra'. The company is collaborating with AIST to develop domestic multimodal AI foundation models.
ITmedia AI+ (日本) · 81d ago
Meta has partnered with EssilorLuxottica to release new AI-powered smart glasses. The product features integrated smart audio and hands-free capture capabilities across 26 different frame styles.
TestingCatalog · 88d ago
Meta has launched a new iteration of its branded smart glasses priced at $299. The company is also exploring the development of camera-free hardware models for future releases.
Bloomberg Technology · 88d ago
DeepSeek has officially rolled out its multimodal image recognition feature across web and mobile platforms. While the web interface is fully functional, the mobile app currently indicates that the feature is still in internal testing.
cnBeta (Full RSS) · 93d ago
SERAF is a new framework that improves time series forecasting by combining numerical data with self-generated textual descriptions. By performing dual retrieval, it overcomes the limitations of traditional similarity-based methods in non-stationary environments.
ArXiv AI · 95d ago
The v0.18.0-preview.0 release introduces significant improvements to the Qwen-code CLI, including auto-update support, multimodal support for qwen3.7-plus, and new automated triage workflows. It also refines user experience with better status displays and expanded skill management capabilities.
Qwen (GitHub Releases: qwen-code) · 102d ago
The 'Query Retrieve Conclude' framework addresses the challenge of interpreting dynamic, emerging memes by retrieving real-time web evidence. It outperforms existing zero-shot baselines in both meme understanding and detection tasks.
ArXiv AI · 105d ago
A hands-on evaluation of the MiniMax M3 model, testing its visual reasoning capabilities against complex Nvidia presentation slides. The test demonstrates the model's ability to process and understand dense visual information.
量子位 · 109d ago
Amazon has significantly reduced prices on Meta Ray-Ban smart glasses for Memorial Day. The discount applies to both second-gen Ray-Bans and Oakley HSTN models.
ZDNet AI · 120d ago
ByteDance's video editing app CapCut has integrated Google's Gemini model. Users can now generate or edit video content through natural language chat commands.
Ifanr (爱范儿) · 121d ago
Chance AI has raised millions of dollars in angel funding led by Meitu. The startup is building a 'Visual Agent' that uses camera input as the primary interface to understand user intent and perform actions.
36氪 · 122d ago
Google is preparing a significant update for its Gemini desktop client on Mac. The release will introduce advanced capabilities including Voice Mode, Stream to Cursor, and Omni video generation.
TestingCatalog · 124d ago
Microsoft has integrated advanced AI tools directly into the Edge browser for both desktop and mobile. New features include multi-tab reasoning, Vision, Voice, and specialized study tools to enhance user productivity.
TestingCatalog · 128d ago
Google is redefining the computer cursor with a Gemini AI upgrade on Chromebook. Users can point at screen elements, speak commands, and receive contextual help across the desktop.
Digital Trends · 130d ago
Thinking Machines is developing an AI model that processes user input and generates responses simultaneously. This shifts from turn-based interactions (talk, listen, respond) to real-time, phone call-like conversations.
TechCrunch AI · 130d ago
A new ArXiv paper shows spatial priming via coordinate grid overlays on charts significantly improves multimodal LLM data extraction accuracy over semantic prompting. Semantic methods like metadata-first and Chain-of-Thought yielded no gains.
ArXiv AI · 130d ago
Thinking Machines announced new Interaction Voice Models. The preview demonstrates AI for real-time native exchange across audio, video, and text modalities.
TestingCatalog · 131d ago
Zhuoyu Technology released a native multimodal foundation model for mobile physical AI at Beijing Auto Show, emphasizing pre-training fusion of vision, audio, and actions. VP Yu Beibei argues this transition is a survival imperative for algorithm vendors amid competition from digital AI giants.
36氪 · 140d ago
This AWS Machine Learning Blog post explores the workings of multimodal biological foundation models (BioFMs). It showcases their real-world applications in drug discovery and clinical development.
AWS Machine Learning Blog · 149d ago
A user-shared stack enables running Qwen3.6-27B model at 85 tokens per second with 125K context length and vision support on a single RTX 3090 GPU. This setup was developed overnight and posted on Reddit for the community.
Reddit r/LocalLLaMA · 149d ago
Horizon Robotics introduces its equivalent to Tesla's FSD combined with Grok AI. The system adapts machines to human expression habits.
Ifanr (爱范儿) · 149d ago
Following Doubao, Alibaba's Qianwen is pursuing a 'face' or persona. Major tech firms are increasingly anthropomorphizing their AI models.
钛媒体 · 150d ago
OpenAI has reclaimed the top spot in AI image generation capabilities. The update highlights their renewed leadership in this domain.
The Neuron · 150d ago
ChatGPT Images 2.0 upgrades image generation with enhanced reasoning capabilities, producing clearer text and more reliable outputs. This advancement positions it closer to true multimodal AI, potentially revolutionizing AI image creation workflows.
TechRadar AI · 151d ago
Kimi K2.6 is endorsed as a strong Opus 4.7 replacement, matching 85% of its task quality. It supports vision, browser use, and excels in long-horizon tasks.
Reddit r/LocalLLaMA · 152d ago
Google's Gemini now generates personalized AI images by accessing users' Google Photos libraries. This update simplifies feeding personal photos into the image generation system, dubbed Nano Banana, for more relevant outputs.
Ars Technica · 156d ago
Google's Gemini app now offers new ways to create personalized images. Nano Banana 2 leverages your personal context and Google Photos to generate images that reflect your unique life.
Google AI Blog · 156d ago
Gemma 4 31B impresses with high-quality 3D models from complex images like an F1 car, outperforming Claude Sonnet 4.6, Gemini 3.1 Pro, ChatGPT, and Qwen3.5 27B. It generates superior results in just 3600 tokens versus competitors' 6800+ and flawed outputs.
Reddit r/LocalLLaMA · 156d ago
ZhiXiang Future has secured a new funding round exceeding 500 million RMB. The company plans to focus on developing the next-generation native full-modality world model.
量子位 · 156d ago