For some reason the engine that can run the 120B/145B models (edge0-strata) only seems to support CUDA for now:

https://github.com/Edge0-AI/Edge0/tree/main#platforms