care to go more into your loop that you've setup

Not much too it! Use Hermes, *Claw, Claude cowork, etc and go like "setup this model <huggingface link> using stablediffusion cpp on this computer." Then when its done, in the same session "Use this as the main image (or video) generator moving forward" and it'll change the config