I think it’s currently too easy to get drunk on easy success cases for AI.

It’s like asking a college student 4th grade math questions and then being impressed they knew the answer.

I’ve use copilot a lot. Faster then google, gives great results.

Today I asked it for the name of a French restaurant that closed in my area a few years ago. The first answer was a Chinese fusion place… all the others were off too.

Sure, keep questions confined to something it was heavily trained on, answers will be great.

But yeah, AI going to get rid of a lot of low skilled labor.

Sure, we might have hit a wall in some important sense, where further progress on some kinds of abilities is blocked until we try something totally different. But we might not. Nobody has any clue.

> Today I asked it for the name of a French restaurant that closed in my area a few years ago. The first answer was a Chinese fusion place… all the others were off too.

What's the point of this anecdote? That it's not omniscient? Nobody is should be thinking that it is.

I can ask it how many coins I have in my pocket and I bet you it won't know that either.

It’s like asking a college student 4th grade math questions and then being impressed they knew the answer.

No, it's more like asking a 4th-grader college math questions, and then desperately looking for ways to not be impressed when they get it right.

Today I asked it for the name of a French restaurant that closed in my area a few years ago. The first answer was a Chinese fusion place… all the others were off too.

What would have been impressive is if the model had replied, "WTF, do I look like Google? Look it up there, dumbass."