Tenstorrent QuietBox 2 Launches RISC-V AI

💡RISC-V AI inference hits desktops—new hardware alternative to GPUs for local runs

⚡ 30-Second TL;DR

What Changed

QuietBox 2 enables RISC-V AI inference on desktops

Why It Matters

Expands affordable RISC-V AI hardware options, challenging Nvidia dominance in local inference and lowering barriers for desktop AI development.

What To Do Next

Check Tenstorrent's site for QuietBox 2 specs and pre-order availability.

Who should care:Developers & AI Engineers

Background and context from public sources — not the original article. 7 sources cited.

•TT-QuietBox 2 is liquid-cooled, reducing idle power and heat by 50% compared to prior generations for desk-side deployment.
•System delivers 2,654 TFLOPS at BlockFP8 precision using four Blackhole ASICs in a unified mesh with 480 Tensix cores.
•Starts at $9,999, ships with fully open-source software stack on Ubuntu 24.04, and supports models up to 120B parameters locally.
•Features 128 GB GDDR6 high-speed memory, 256 GB DDR5 system memory, and avoids HBM to mitigate supply chain issues.

•Equipped with 4x Tenstorrent Blackhole p150c Tensix Processors, providing 480 Tensix Cores and 64 big RISC-V cores.
•Memory: 128 GB GDDR6 (high-speed), 256 GB DDR5 system memory; integrates compute and SRAM on-die for dataflow architecture.
•Connectivity: 16x QSFP-DD 800G ports (4 per card), Ethernet-based mesh topology; host: 2x 10GBase-T, 2x 1GBase-T, USB 3.1, IPMI.
•Power: 1650W 80 PLUS Platinum PSU, plugs into 120V outlet; dimensions 10” x 21.5” x 20”, weight 79.2 lbs.
•Storage: 4 TB NVMe PCIe 4.0 x4; OS: Ubuntu 24.04 LTS; CPU: 16 cores/32 threads up to 3.0 GHz.