Reminds me of when microwaves first came out. Investors decided to go all in on "vibe cooking" (lit. cooking with vibrations) complete with microwave ranges (no conventional oven), until the public wizened up to the fact that there was in fact no cooking (Maillard reaction) involved in their vibe cooking. Took about 15-20 years but microwaves finally took their rightful place as a utility appliance rather than what they were touted as (a centerpiece). Pick up a microwave cookbook from the 50s for some laughs.

“But they’ve added RL so…!!!”

You are obviously right and I see examples of it everywhere.

E.g I asked Claude opus 4.7 (the latest/greatest) the other day “is a Rimworld year 60 days?”. The reply (paraphrased) “No, a Rimworld year is 4 seasons each of 15 days which is 60 days total”.

Equally, it gets confused about what is a mod or vanilla since it is just predicting based on what it read on forums, which are clearly ambiguous enough (to a dumb text predictor).

Your house is literally just a box. You can dress it up however you want but it has 4 walls and a lid.

By design. At least until we move away from attention being at the core of LLMs

For a good reminder for people on the limitations of AI (or well OAI gpt 5.3 default model for non paying users), I did an experiment recently (Just a week-ish ago): https://smileplease.mataroa.blog/blog/how-many-e-are-in-stra...

image: https://mataroa.blog/images/b5c65214.png

but it says that there are 3 e's in strawberry ;)

Now this is literally something which occurs because of it being text autocomplete and the inherent issue of token based Large language models. So you are literally right :D

My point is that AI can have its issues and it can have its plus points (just like text autocomplete but some suggest its on steroids)

The issue to me feels like we are hammering it in absolutely everything and anything, perhaps it should be used more selectively, y'know, like perhaps a tool?