>ELIZA couldn't write working code from an English-language prompt though.

Yea, that is kind of the point. Even such a system could trick people into delusional thinking.

> actually good at replacing a lot of activity that coders are used to...

I think even that is unrealistic. But that is not what I was thinking. I was thinking when people say that current LLMs will go on improving and reach some kind of real human like intelligence. And ELIZA effect provides a prefect explanation for this.

It is very curious that this effect is the perfect thing for scamming investors who are typically bought into such claims, but under ELIZA effect with this, they will do 10x or 100x investment....