| ▲ | TheDong 2 hours ago | |
If you want to run better models, you need one of the more expensive GPUs, like an H100 or such ($40k). I don't think any of the smaller models are remotely comparable to anthropic. The GPU also takes around $500-$1000 in electricity, and even then you won't be able to run a model of as good quality as anthropic. It's also hard to justify since who knows how quickly it will be outdated, like maybe soon you'll need a blackwell chip (like a $100k PC, check out the NVIDIA DGX Station) to run a decent model. ... It'll take a lot more than a year to pay back a model capable of running openclaw with any sort of reasonable performance. Or can you report that you've had good luck with a Strix Halo or local GPU for less than $40k up-front costs? | ||