Remix.run Logo
botro a day ago

This is damn near prescient, I'm having a hard time believing it was written in 2021.

He did get this part wrong though, we ended up calling them 'Mixture of Experts' instead of 'AI bureaucracies'.

robotresearcher a day ago | parent | next [-]

We were calling them 'Mixture of Experts' ~30 years before that.

https://ieeexplore.ieee.org/document/6215056

stavros a day ago | parent | prev [-]

I think the bureaucracies part is referring more to Deep Research than to MoE.