Krasis Hits 3324 tok/s Prefill on RTX 5080

🔑 Enhanced Key Takeaways

• •RTX 5080 uses Blackwell architecture with 10,752 CUDA cores and 16GB GDDR7 VRAM, enabling high AI inference speeds but limited to smaller or quantized models due to VRAM constraints.[1][2]
• •In general LLM benchmarks, RTX 5080 achieves around 135 tok/s with two loaded models and up to 26.1 tok/s in specific Vulkan tests, far below Krasis's 3324 tok/s prefill.[4]
• •RTX 5080 outperforms RTX 6000 Ada in Mistral (4635 vs 4255) and Llama2 (4790 vs 3957) tests but trails RTX 5090 and RTX 4090 in most AI workloads.[1]

🔮 Future ImplicationsAI analysis grounded in cited sources