| ▲ | siavosh 2 hours ago | |
What's everyones recommendation for one to run a good local LLM model on? | ||
| ▲ | manmal 2 hours ago | parent | next [-] | |
1-2 RTX5090 will be better value than Macs because they have the memory bandwidth for somewhat fast local inference. | ||
| ▲ | bigyabai 2 hours ago | parent | prev [-] | |
If you don't want to wait for prefill, you're going to want a CUDA dGPU system. | ||