The thought experiment was not assuming AGI, but something like an old school perfect expert at a given task. Maybe like C-3PO only useful as a “protocol droid”, but fairly useless at everything else