Remix.run Logo
noncoml an hour ago

I kind of angree with the anrgument that for an ideal AGI abstractions are not needed. It would write everything perfectly without even needing a programming language. It would know everything to the byte and would create perfect machine code meeting all the requirements as perfect as it’s possible.

But the reality is different. First of all LLM were trained on current data, with the abstractions we currently use.

Secondly they suffer they same problems we do, their context size is way too small to just simply ignore abstractions.