re: questionable legality https://arstechnica.com/tech-policy/2025/02/meta-torrented-o...

> Moreover it's not hard to think of vaguely similar objections to fertilizers.

It's completely different. If LLM companies pulled this out of thin air it would be also different, but no; they've effectively plundered the commons and locked up all the profit for themselves. If intellectual labor goes the way of agricultural labor, I think humanity will have lost something valuable.

And don't come back with the "farmers would have said the same thing about the industrial revolution!" thing again if you're just going to terminate your thought there. Automating agricultural labor brings vast material benefits for all since it lowers the cost of tangible goods needed for life. I'd challenge you take this one step further and explain why automating intellectual labor will provide similar fruits and is therefore something to cheer for.

If we actually do meaningfully automate intellectual labor, we create a world where we have real technical solutions for our toughest problems. Maybe we can get carbon capture and fusion energy working. There’s a theoretical world of abundance for us to explore.

That’s the steel man argument.

FWIW I mostly don’t believe that LLMs are the answer, I don’t think they’re going to reach a high enough level of capability to do this, and I think the current AI companies are problematic in a lot of ways.

I also think LLM use is bad for us and probably harms our thinking abilities. And using it takes away a lot of what it means to be human.

Personally I like both physical and mental difficulty. I like gardening even if I could just buy mass produced flowers. I like riding a bike even though cars are “easier”. I like playing ukulele with my family even though I can barely make a chord, much better than listening to some other real musician, or Suno ai generated songs. I like eating my wife’s sourdough bagels even if they take several hours more than just buying some.

And I think having those regular challenges and achievements make life worth living! And I worry that the AI future that some envision will make much of what we get value from feel meaningless in the same way that writing code by hand is starting to.

Maybe we’ll still be fine in the same way I find meaning in all of those things that I listed above. But damn what a gamble