Nvidia fits a 74-billion-parameter agent model into 24 GB of VRAM

On October 15, 2026, Nvidia launched Nemotron 3.5 Bolt, a 74-billion-parameter agent model compressed with 2-bit quantization to fit in 24 GB of video memory, runnable locally through llama.cpp, Ollama or LM Studio. If you want a local agent for coding or browsing, test it; extreme quantization remains a tradeoff you must measure on your own tasks.