Note that addition that's "trillion times faster" is purely an optimization, not greater intelligence.

And a society of humans does not increase our overall intelligence. It allows all of humanity to access the accomplishments of our most intelligent members throughout history (which is huge, don't get me wrong!) but it seems almost self-evident that our civilization as a whole is not smarter than Newton/Einstein/von Neumann/etc.

Intelligence is also access to data, along with all of it's other requirements. Society as a whole is far smarter than Einstein.

If I dump Einstein on an island at 5 you don't get a theory of relativity. The data provided by a civilization is required, hence why people 10,000 years ago didn't go to the stars. It is unlikely they were significantly less intelligent than us. They just didn't have the language of data we do now.