Models that see, hear and speak are replacing text-only systems. Coverage of vision-language models, native audio and video understanding.
354 articles
Luckin reports 43% revenue growth to 493B RMB, 31K stores; ramps AI with Lucky AI using Doubao LLM for voice ordering, payments via Alipay/HarmonyOS. R&D steady at ~6% but focuses multimodal for recs/supply chain.
虎嗅 · 203d ago
Chart Insight Agent Flow is a new multi-agent framework that uses MLLMs to extract profound insights from chart images, surpassing basic descriptions. It introduces ChartSummInsights, a dataset of real-world charts with expert-written insightful summaries.
ArXiv AI · 206d ago
Hugging Face blog details deploying open-source Vision Language Models (VLMs) on NVIDIA Jetson edge devices. This guide enables efficient on-device inference for multimodal AI tasks.
Hugging Face Blog · 206d ago
量子位實測 Spark X2.5，展示其生成粒子月亮、分析長達 61 頁的財報，以及協助找出程式 Bug 的能力。文章聚焦模型在創意生成、長文件理解與程式除錯場景中的實際表現。
量子位 · 9d ago
Vellum Mobile’s iOS app now functions as a mobile AI assistant with native Voice Mode, camera capture, Lock Screen activities, and Mac control. The update expands the app beyond chat into hands-free, multimodal, and cross-device workflows.
TestingCatalog · 22d ago
Meta is developing an AI application called StoryKit that generates personalized stories for children. The tool allows parents to create content with custom characters, scenes, and music without requiring manual writing.
cnBeta (Full RSS) · 58d ago
Google DeepMind has entered into a formal research partnership with the film production company A24. This collaboration aims to explore the intersection of advanced artificial intelligence and creative storytelling.
DeepMind Blog · 77d ago
Proton has significantly upgraded its Lumo chatbot by integrating new image generation and editing capabilities. This update expands the tool's utility beyond text-based interactions, focusing on privacy-centric AI workflows.
Engadget · 80d ago
Meta is donating Ray-Ban Meta smart glasses to all blind veterans in the United States. This initiative aims to provide them with transformative AI-powered assistive technology.
Meta Newsroom · 98d ago
Apple is exploring the integration of camera technology into future AirPods models. The move aims to enhance spatial computing capabilities but faces significant challenges regarding battery life and user privacy.
Wired AI · 105d ago
Guangfan Technology has launched a new pair of AI-powered earbuds featuring an integrated camera. The product is priced at $275 and is positioned as a competitor to the anticipated Apple AirPods Ultra.
Pandaily · 115d ago
A new report highlights that video-related revenue accounted for 73% of the podcast industry's growth in the US last year. This shift underscores the increasing importance of multimodal content strategies in digital media.
Bloomberg Technology · 121d ago
Guangfan Technology announced the upcoming sale of the world's first active AI earphones with visual perception capabilities. The Guangfan All-Sense AI Earphones, featuring a camera, will officially launch on May 15.
36氪 · 132d ago
Apple is testing next-generation AirPods with built-in cameras to give Siri visual input capabilities. This wild-sounding feature aims to modernize Siri and overcome its outdated limitations.
Digital Trends · 133d ago
This arXiv paper introduces a knowledge-driven LLM-based system for defect diagnosis and mitigation in Laser Powder Bed Fusion (LPBF) manufacturing. It integrates an ontology with 27 defect types, supports fuzzy natural language queries, and features multimodal image assessment.
ArXiv AI · 135d ago
Experiment tested 4 frontier multimodal models on valuing 15 paintings worth $1.46B using image-only or image + metadata. Found 'recognition vs commitment gap': models recognize art visually but hesitate on valuation without text.
Reddit r/MachineLearning · 155d ago
Alibaba's Qwen AI Glasses S1 are now on sale for USD 500. Key features include multimodal voice-vision interaction, dual-eye displays, a 12MP camera, and hot-swappable batteries for all-day use.
Pandaily · 156d ago
University of Washington researchers have developed AI-powered earbuds with integrated cameras. The earbuds translate text and identify objects in real-time surroundings while prioritizing user privacy through on-device processing.
Digital Trends · 157d ago
Tsinghua researchers created the first end-to-end closed-loop full-modal safety desensitization system. Dubbed for enabling 'lobster safe landing,' it addresses multimodal AI safety challenges.
量子位 · 161d ago
Amid intense competition in visual tech, a furniture company doubles down on 'hand feel' innovation. Their products are used by 6 of the global top 10 tech companies.
量子位 · 179d ago
Google is testing Search Live in additional markets beyond US and India, retracting earlier global rollout claims. The feature, now powered by Gemini 3.1 Flash, enables camera-based queries for more natural, multilingual interactions.
Engadget · 183d ago
A Reddit post on r/LocalLLaMA announces MiniMax M2.7 is coming soon. The community speculates it may introduce multimodal capabilities.
Reddit r/LocalLLaMA · 184d ago
ChatGPT now integrates Shazam for in-chat song identification without launching the app separately. Users link via Apps page and prompt 'Shazam, what’s playing?' to activate.
Engadget · 192d ago
Google's Techspert blog explains how AI Mode in Search understands visual queries via the query fan-out method. This technique generates multiple interpretations from images to improve search accuracy.
Google AI Blog · 197d ago
Google Home announces updates including 'Live Search,' enabling Gemini to describe live camera feeds in real-time. Users can ask questions like 'Is there a car in the driveway?' Gemini for Home now uses updated models for better accuracy and media playback.
The Verge · 199d ago
Qwen 3.5 2B runs on Google Pixel 9 Pro Android device, acing basic questions, image description with text translation, and complex diagram explanations. It halted mid-task on a diagram, possibly due to app bugs or 2048 context limit.
Reddit r/LocalLLaMA · 199d ago
iFlytek debuted AI Glasses at MWC 2026, designed for face-to-face talks with real-time translation subtitles on lenses and audio playback. Weighing just 40g, it pioneers lip-reading multimodal noise reduction for noisy settings, boosting accuracy over 50%.
IT之家 · 200d ago
Apple’s camera-equipped AI AirPods project reportedly remains on track for a 2027 release. A company leak had suggested the product could arrive earlier, but the current timeline has not changed.
Bloomberg Technology · 29d ago
Apple may have unintentionally revealed camera-equipped AirPods in a video hidden inside macOS Tahoe 26.7. The discovery suggests Apple could be exploring camera-enabled wearable audio devices, though no product launch has been confirmed.
Engadget · 31d ago
A demo video found in the macOS Tahoe 26.7 release candidate appears to reveal Apple’s camera-equipped AirPods. The footage offers the clearest indication yet of how the built-in camera could function, though Apple has not officially announced the product.
Digital Trends · 31d ago