The same LLMs you have to rent from the very richest people on earth? I would be careful to call that freedom

jasonvorhe 2 days ago | parent | next [-]

There's people running close to frontier model grade local AI on consumer and prosumer hardware, let's not act as if it was impossible to skip having to rent from OpenAI or Anthropic.

	▲	lionkor a day ago \| parent [-]
		Have you seen hardware prices? They are so high that it's not even affordable for upper middle class in most of the world.

▲

papyrus9244 2 days ago | parent | prev [-]

You know you can run LLMs on your own computer, right?

▲

palata 2 days ago | parent [-]

If you can afford a computer that can run LLMs, sure.

▲

flossly a day ago | parent [-]

"afford" in this case has to be compared to the cost of renting.

▲

palata a day ago | parent [-]

Of course. Someone who pays 150$ a year for Claude Pro would need years to get to a 4k machine.

▲

flossly a day ago | parent [-]

150$/month, for year...

I've seen businesses that made the infrastructure to share a 100k machine. They needed it "on premise", but the setup did not look too hard and the results were outstanding compared to Claude Opus.

	▲	palata 20 hours ago \| parent [-]
		> 150$/month, for year... Claude Pro is 15$/month. Not everybody can afford 150$/month.