Remix.run Logo
▲ Aurornis a day ago

> Would that imply the entry-level MacBook will have 128GB

Most people neither need nor want to run large LLMs locally.

The entry level MacBook Neo costs $599. Even if RAM prices revert to the pre-AI mean, the entry level models are not going to be that stacked with RAM.

Eventually we'll get to a doubling where entry level means 16GB of RAM, but most people won't be running anything more than simple models for light local work.

Have you ever tried running large LLMs on a MacBook Pro? It's hot, loud, and makes your battery level disappear at rates you didn't know were possible if you're not plugged in. It's a very niche hobby.

▲I-M-S 20 hours ago | parent | next [-]

As long as the models are censored (and under our system they have to be to reduce liability), there will be need for local LLMs.

▲krzyk 17 hours ago | parent [-]

Local models are also frequently censored (try to search for some pirated content), depending on the provider.

You can get uncensored versions, but they are less usable (lobotomized).

▲spopejoy 12 hours ago | parent [-]

If you select with care you can get fully-functional abliterated models. There are good abliterated Qwen 3.8 27B models and quantized versions thereof. Heretic Grimoire models are a good starting point.

▲LUmBULtERA a day ago | parent | prev | next [-]

The first time my family bought standalone RAM to upgrade our PC, it cost over $100 for 2 MB. Not GB, but MB. Consumers will get much larger stacks of RAM at some point, likely sooner than later.

▲otabdeveloper4 a day ago | parent | prev | next [-]

> running large LLMs on a MacBook Pro

Whatever local LLM device comes out of this, it certainly won't be a laptop.

(I envision a black box like a router you plug into a socket and let sit in a corner of some room.)

▲CompoundEyes a day ago | parent | prev | next [-]

Don’t underestimate porn. There will be a moment when the average consumer can create personalized porn and erotica fully offline with a local LLM.

▲whycombilater a day ago | parent | next [-]

Well, they've captured the paedophile market then.

Personally, I find the whole idea of AI porn pretty depressing. Porn is very bad acting, or no acting, but at least the people are real.

▲hobo123 16 hours ago | parent | prev [-]

Don't all models block that, and also not train on pr0n data?

First someone would need to invest and train a model on pr0n, and then they'd likely first want to recoup that money - perhaps by selling a subscription to pr0n addicts.

▲usrnm a day ago | parent | prev [-]

> Most people neither need nor want to run large LLMs locally

I'm old enough to remember the time when most people neither needed nor wanted a phone with a large screen and no buttons

▲AdamN a day ago | parent [-]

I'm old enough to remember in NYC when people knew the number of their local car service and that tools like Uber were 'dumb' because how could they compete with something that was already so simple ...