> and the hardware requirements for any kind of LLM

You can run bonsai2 27b on basically any gaming GPU from the last 15 years including on game consoles.

Everyone has access to this stuff now if they bothered to look beyond the marketing from big labs trying to collect subscription revenue.

I work on compilers, kernels, and operating systems using exclusively consumer GPUs.