Replied to Running Qwen and Gemma locally: quantisation trade-offs · 18 OctWe moved to streaming everything and p95 dropped a lot. 😅
