Tag: #datacenter12 results
General Compute reportedly secured a $400 million loan using specialized SambaNova inference chips as collateral instead of GPUs. The deal is presented as a sign that investors are increasingly interested in inference-focused infrastructure for open-source AI models.
At GTC, NVIDIA unveiled the Vera Rubin system integrating Groq LPU, a 7-chip AI infrastructure optimized for inference with disaggregated prefill on GPU and decode on LPU. This addresses GPU limits in high-speed token generation, boosting 1GW datacenter token output 350x. NVIDIA projects $1T GPU market by 2027 driven by agentic AI inference surge.
Microsoft is reportedly planning to significantly increase production of its next-generation AI chips, according to The Information. The move highlights Microsoft’s effort to strengthen its custom silicon capabilities as demand for AI infrastructure grows.
New York Governor Kathy Hochul has signed an executive order imposing a one-year pause on the construction of new hyperscale datacenters. The move aims to address the resource-intensive nature of these facilities, which are critical for powering AI workloads.
NAACP sued Elon Musk's xAI in Mississippi court for Clean Air Act violations. The suit targets unpermitted methane gas generators powering Memphis-area datacenters. Emissions allegedly pollute nearby Black neighborhoods in Tennessee-Mississippi border.
Anthropic has disclosed a $30 billion annual run rate and intends to use 3.5GW of new AI accelerators from Google. Broadcom is producing these next-generation AI and datacenter networking chips for Google. Broadcom expresses enthusiasm but flags Anthropic as a risk.
xAI has won approval to operate 41 methane gas turbines at its Colossus 2 datacenter in Mississippi, nearly doubling its current capacity. These turbines power the AI supercomputers running Grok. The decision comes despite public backlash.
AMD has invested $250 million in Nutanix through a chips-and-stock deal to develop an AI software stack optimized for its GPUs. The partnership targets software-defined datacenters amid VMware customer migrations. Supply chain challenges are also noted.
Moonshot's Kimi enables prefill/decode disaggregation across datacenters using hybrid Kimi Linear model to shrink KV cache. Delivers 1.54x throughput and 64% lower P90 TTFT on 20x scaled model. Lowers token costs via PaaS.
Jeff Bezos' Blue Origin has applied to the FCC to launch up to 51,600 datacenter satellites for Project Sunrise. The initiative requires a new satellite network that doesn't exist yet, the New Glenn rocket with minimal flight history, and regulatory approval.