Remix.run Logo
AnimalMuppet 2 days ago

Touch humans in some way.

AI interaction is fundamentally unsatisfying. (I have a theory as to why; see below.) An AI can get you results, maybe even the results you wanted, but it can't give you a genuine smile. Even when we're surrounded by things that get us results, we still want the smile. So if you're doing something where you interact with people face to face, at least some of the time, that's a decent place.

In my large town/small city, there's an ice cream shop that closes between Thanksgiving and roughly March 1st. I would love to own a business that people cared as much about as they care about that place opening for the year.

-----

Why is interacting with an AI unsatisfying? I wonder if it doesn't come down to information theory. AI output has too little information in it.

You compute the information in a text by going symbol by symbol. Normally "symbol" means one character or byte. But you could do it by going word by word (or word part by word part) instead. Here you can see the problem: an AI gives you whatever word is the most probable next word, given the context. That's lower information than human output, which would give a wider variety of next words, and therefore a higher (Shannon) information content.

Yes, you can change that by increasing the temperature of the AI. Can you do that enough to give human-equivalent information content without destroying the coherence of the output? (Merely high Shannon information isn't the only goal. The insane may have high information in their output, but they are incoherent enough that it doesn't matter.)