> 145B parameters with only peak 29GB memory usage - really impressive

They're doing offloading, the full model doesn't live in VRAM at all. They're expecting you to do ~30GB VRAM + the rest on system RAM.