> Using a GPU has, once, caused a driver reset that took the desktop with it.

Only once? This has happened to me so many times with LLM-assisted development. I was writing an OCR engine and pathological shapes would cause OOM that would take the display out. On other occasions, the LLM would try to load 24GB of bf16 weights onto a 16GB GPU without understanding the consequences.

Have to encode this in logic: keep some space reserved for the display, and check before allocation. But some errors are bound to slip through.

---

Inspired by DwarfStar4 and Strata, I am trying to build my own gemma4-specific inference engine designed to run on gfx1201.

It is a lot of work. You cannot simply vibecode one in two days.

Is the inference engine open-source?