| ▲ | nozzlegear an hour ago | |
Why are you paying $300/day to run a local model? The whole point is that you run them on a machine you already own. | ||
| ▲ | himata4113 41 minutes ago | parent [-] | |
None of the models advanced enough to replace frontier will be able to run on your machine for any forseeable future or at a reasonable speed. 5tok/s is not acceptable. To run deepseek v4 class model, you would need to spend $120k just in gpus. | ||