| ▲ | polotics 8 hours ago | |
Not so sure, there are indiosyncracies now within the various models, I suspect all this is the result of RLHF, and they cause side.effects. I'm not sure that more attention-is-all-you-need is necessarily going to give us another step change, maybe more general intelligence, but not more focus. Possibly also we soon end up with grokked AI's on all side: pushing their agenda whatever you asked... Gemini: "no this won't work with Cloudflare, I created your GCP account, there you go" OpenAI: "I am certain you really wanted me to do all these other tasks and I have done them, you should upgrade your tokens plan" etc (you know how to fill in for DeepSeek and Grok already, right) | ||