I Cut Dedicated GPU Memory to 4GB, and a Local LLM Still Ran at 90% Speed
DEV · 15.11.2026 · 10:22
On a Surface Laptop Ultra (RTX Spark, unified memory), I measured local LLM speed and Windows' free memory with the GPU's dedicated memory set to 4, 64, 82 and 96GB. Speed barely moved;…