AI that runs on-device — phones, cars, cameras and sensors. Privacy-friendly, latency-free inference outside the cloud.
417 articles
Qwen3.5-27B model runs offline on a $15 Raspberry Pi Zero 2W with only 512MB RAM, at a few tokens per hour. Custom implementation streams weights from SD card, computes, and clears memory without mmap or swap.
Reddit r/LocalLLaMA · 170d ago
Lenovo has launched two AI-native devices: YOGA AI Mini for consumers and Think AI Tiny for enterprises. This expands its AI-powered computing across personal and business use cases.
Pandaily · 170d ago
The LD-framework enables reliable DC arc-fault detection in PV systems despite spectral interference, hardware heterogeneity, and operating drifts. It achieves 0.9999 accuracy, 0% false trips across nuisance conditions, and effective cross-hardware transfer with minimal data.
ArXiv AI · 173d ago
Meta's SAM 3.1 improves multi-object tracking in video, handling 16 objects in one computation pass vs separate per-object in SAM 3. This makes real-time local inference practical on smaller hardware.
Reddit r/LocalLLaMA · 176d ago
Plant engineers deploy quantized Mistral 7B and Llama 8B on Jetson Orin for 24/7 anomaly detection on 140k+ vibration sensor readings per hour. Setups run 11 months continuously in food plants with electricity as sole ongoing cost.
Reddit r/LocalLLaMA · 176d ago
Qualcomm predicts personal AI will originate from on-device edge computing. The company is advancing toward multi-terminal experiences centered on AI and users.
量子位 · 176d ago
OpenClaw sparks hardware boom in Huaqiangbei with 'shrimp tanks' and Agent boxes solving deployment, offline, Token costs via local models. Tiiny AI Pocket Lab crowdfunds $2.5M on Kickstarter; categories include plug-and-play boxes, multimodal sensors, multi-device hubs.
36氪 · 176d ago
Nemotron 3 Nano 4B is a new compact hybrid model designed for efficient local AI deployment. Hosted on Hugging Face, it targets edge devices with reduced resource needs.
Hugging Face Blog · 186d ago
Huawei released new AI data infrastructure for inference scenarios, including the central AI Data Platform and edge FusionCube A1000 hyperconverged machine. It unifies knowledge base, KV Cache, and memory management to boost Agent accuracy by 30%.
36氪 · 186d ago
Critiques AI features in Chinese smartphones from Huawei, Honor, Xiaomi, OPPO, vivo amid hype like 'dragon shrimp universe' and robot phones. Highlights gaps in usage, proactivity, ecosystem, privacy despite param wars.
虎嗅 · 191d ago
Qualcomm launched Ventuno Q, a sophisticated Arduino single-board computer for AI and robotics. Powered by Dragonwing IQ8 with 8-core ARM CPU, GPU, and 40 TOPS NPU.
Engadget · 193d ago
Black芝麻智能 placed 33.54M shares to Infini Capital at 18.88 HKD/share, raising 631M HKD. Funds target next-gen high-performance chip R&D, robot and end-side AI product expansion, commercialization.
36氪 · 193d ago
NXP Semiconductors has launched the i.MX 93W application processor, the first to integrate a dedicated AI NPU with secure tri-band wireless connectivity in a single package. Designed for accelerating physical AI deployments at the edge, it replaces up to 60 discrete components.
36氪 · 193d ago
AMD upgraded the Ryzen AI Embedded P100 series for the vast embedded market. CPU cores doubled to 12, GPU performance rose 8x.
cnBeta (Full RSS) · 193d ago
SK Hynix has developed the world's first 1c process 16Gb LPDDR6 DRAM for edge AI demands. It offers 33% faster data processing over 10.7Gbps than LPDDR5X and over 20% lower power consumption.
IT之家 · 194d ago
Qualcomm's new Arduino Ventuno Q SBC targets robotics with Dragonwing IQ8 processor (40 TOPs NPU) and STM32H5 MCU. Runs offline AI models like LLMs, vision; full robotics stack.
Engadget · 194d ago
Qualcomm launched the Snapdragon Wearable Platform Supreme Edition, fitting 2 billion AI parameters into a brooch-sized device. This release completes the final puzzle piece in Qualcomm's personal AI ecosystem for wearables.
量子位 · 199d ago
Renesas' R-Car V4H ADAS SoC is deployed in Toyota's sixth-generation RAV4 TSS control unit supplied by Denso. It uses built-in AI neural networks to process front camera data, fusing it with radar for precise vehicle, pedestrian, and obstacle detection.
IT之家 · 201d ago
GigaDevice and Tuya Smart announced deep technical collaboration. Built on GD32 MCU wireless platform with TuyaOpen framework, AI models, and cloud services.
36氪 · 201d ago
Qualcomm announced the Snapdragon Wear Elite chip for AI wearables like pendants, pins, and display-free smart glasses. It complements the W5 Plus chip and uses a 3nm process with eNPU and Hexagon NPU for AI processing.
The Verge · 201d ago
Hugging Face blog details deploying open-source Vision Language Models (VLMs) on NVIDIA Jetson edge devices. This guide enables efficient on-device inference for multimodal AI tasks.
Hugging Face Blog · 208d ago
Raspberry Pi Foundation published a guide for running OpenClaw on Pi 5, featuring a wedding photo booth demo. Adafruit covered it, and Medium bloggers are documenting setups.
OpenClaw.report · 211d ago
Node Learning is a decentralized paradigm where edge nodes learn continuously from local data and exchange knowledge opportunistically via peer interactions. It propagates learning through overlap and diffusion, avoiding global synchronization or central aggregation.
ArXiv AI · 211d ago
Local AI agent OpenClaw drives Raspberry Pi stock nearly double in 3 days to £1B cap on cheap hardware hype. Runs on $100 Pi for secure edge tasks vs cloud or pricey Macs.
虎嗅 · 212d ago
India's Sarvam AI plans to deploy its models on feature phones, cars, and smart glasses. The edge models are tiny, occupying only megabytes, run on existing phone processors, and function offline.
TechCrunch AI · 213d ago
摩爾線程 AI Cube 與 Lenovo AI 主機 P7 將本地大模型推理、儲存與家庭設備協作帶入消費市場。文章認為，家庭確實需要端側 AI，但分散在手機、攝影機、NAS 與穿戴裝置中的需求，未必足以支撐一台高價獨立算力設備。
虎嗅 · 12d ago
The article examines how the emergence of DeepSeek, Qwen, and Zhipu models could give PC manufacturers new AI capabilities to work with. AMD is positioning computers as a way to reduce dependence on expensive cloud-based AI token usage.
Ifanr (爱范儿) · 12d ago
The article reviews how the 2021 global chip shortage accelerated domestic substitution in China’s automotive semiconductor supply chain. It covers the barriers to automotive qualification, early mass-production successes, and growing local presence across power semiconductors, cockpit SoCs, MCUs, memory, and safety chips.
虎嗅 · 12d ago
Volkswagen Anhui’s 08 Hunter Edition electric SUV will launch and begin deliveries on September 12 at a presale price of 230,000 yuan. It combines VLA 2.0, dual Turing chips, 1,500 TOPS of compute, and 26 high-precision sensors with an 800V platform and up to 730 km of CLTC range.
IT之家 · 13d ago
Chery has begun rolling out the second OTA update for the Fengyun T11, adding nine features and four major optimizations. The update improves Falcon 700 assisted driving, introduces remote vehicle preparation, autonomous ETC passage, child-seat alerts, and remote diagnostics.
IT之家 · 14d ago