Andrej Karpathy said once that he expects superintelligence could fit in 1 billion parameters.

Super intelligence that doesn't have to deal with the real world, maybe.

I wouldn't be surprised if less than 1B param equivalent of our brain deals with solving math and writing computer programs and physics and all the things we tend to associate with "intelligence" - especially if you ultra optimized for that, I doubt our brain works like that.

Dealing with the real world, I highly highly doubt it.

	▲	Gigachad 2 hours ago \| parent \| next [-]
		It would be interesting if running ends up being a more complex task than advanced math. And our brains are just 95% allocated to dealing with the real world.
	▲	jstummbillig 5 hours ago \| parent \| prev [-]
		How about if we get away from written text as the input, to something more fundamental, that then also is able to produce text (among other things)? Given that humans learn to talk while having encountered a measly number of word instances, and, given enough time, we should always be able to improve on the lottery that is biology, it does seems fairly likely.