AC10 had an interesting post around this general area earlier today:
https://www.astralcodexten.com/p/mysteries-of-ai-generalizat...