Very much wish I had gotten a RTX 5090 for local LLMs but it would have doubled the cost of my PC.

Actually isn’t the cost of a Pi basically a rounding error compared to the 5090 at this point?