It's working for me - it does max out my 64GB though.

Wow. I always forget how unlike autoregressive models, diffusion models are heavier on resources (for the same number of parameters).