Yeah I did something similar but more extensive, because not every model is same plus depend on your options how much you want to degrade model from fp8. Some models is just slow on local hardware and not practical really.

localaicost.com