RAM requirements? My current rule of thumb is “a byte per parameter”, but I doubt this runs in 1/9th that (~ 3GiB).

Also, perf speedup?

I'm seeing around 7.9GB of ram, 120 tokens/s on a 6000 pro blackwell.