๐Ÿฆ™Stalecollected in 2h

Tenstorrent QuietBox 2 Launches RISC-V AI

Tenstorrent QuietBox 2 Launches RISC-V AI
PostLinkedIn
๐Ÿฆ™Read original on Reddit r/LocalLLaMA

๐Ÿ’กRISC-V AI inference hits desktopsโ€”new hardware alternative to GPUs for local runs

โšก 30-Second TL;DR

What Changed

QuietBox 2 enables RISC-V AI inference on desktops

Why It Matters

Expands affordable RISC-V AI hardware options, challenging Nvidia dominance in local inference and lowering barriers for desktop AI development.

What To Do Next

Check Tenstorrent's site for QuietBox 2 specs and pre-order availability.

Who should care:Developers & AI Engineers

๐Ÿง  Deep Insight

Web-grounded analysis with 7 cited sources.

๐Ÿ”‘ Enhanced Key Takeaways

  • โ€ขTT-QuietBox 2 is liquid-cooled, reducing idle power and heat by 50% compared to prior generations for desk-side deployment.
  • โ€ขSystem delivers 2,654 TFLOPS at BlockFP8 precision using four Blackhole ASICs in a unified mesh with 480 Tensix cores.
  • โ€ขStarts at $9,999, ships with fully open-source software stack on Ubuntu 24.04, and supports models up to 120B parameters locally.
  • โ€ขFeatures 128 GB GDDR6 high-speed memory, 256 GB DDR5 system memory, and avoids HBM to mitigate supply chain issues.

๐Ÿ› ๏ธ Technical Deep Dive

  • โ€ขEquipped with 4x Tenstorrent Blackhole p150c Tensix Processors, providing 480 Tensix Cores and 64 big RISC-V cores.
  • โ€ขMemory: 128 GB GDDR6 (high-speed), 256 GB DDR5 system memory; integrates compute and SRAM on-die for dataflow architecture.
  • โ€ขConnectivity: 16x QSFP-DD 800G ports (4 per card), Ethernet-based mesh topology; host: 2x 10GBase-T, 2x 1GBase-T, USB 3.1, IPMI.
  • โ€ขPower: 1650W 80 PLUS Platinum PSU, plugs into 120V outlet; dimensions 10โ€ x 21.5โ€ x 20โ€, weight 79.2 lbs.
  • โ€ขStorage: 4 TB NVMe PCIe 4.0 x4; OS: Ubuntu 24.04 LTS; CPU: 16 cores/32 threads up to 3.0 GHz.

๐Ÿ”ฎ Future ImplicationsAI analysis grounded in cited sources

RISC-V AI hardware will capture 15% of desktop inference market by 2028
QuietBox 2's open-source stack and desk-friendly design lower barriers for local AI adoption beyond x86/GPU dominance.
Tenstorrent ASICs will enable cloud-free 120B+ model training for SMBs
Multi-chip mesh and high TFLOPS at BlockFP8 support diverse workloads without datacenter infrastructure.

โณ Timeline

2023-12
Tenstorrent launches initial TT-QuietBox with Wormhole n150s Tensix Processors
2024-06
Introduces TT-LoudBox and TT-QuietBox variants with Wormhole n300s upgrades
2026-03
Launches TT-QuietBox 2 Blackhole with RISC-V ASICs and liquid cooling
๐Ÿ“ฐ

Weekly AI Recap

Read this week's curated digest of top AI events โ†’

๐Ÿ‘‰Related Updates

AI-curated news aggregator. All content rights belong to original publishers.
Original source: Reddit r/LocalLLaMA โ†—