| ▲ | orangecat a day ago | |
Just give us back our RAM prices so that everyone can afford 256GB DDR5 and run their models locally! And Sam's (correct) point is that that doesn't work. If everyone tried to run the same amount of inference locally with the same size models that they're currently doing, the shortage would be even worse. | ||