| ▲ | jjulius 10 hours ago | ||||||||||||||||
I appreciate how they don't tell us what lesson they learned. | |||||||||||||||||
| ▲ | dcre 9 hours ago | parent [-] | ||||||||||||||||
It is a thread. You may have only seen the first tweet because Twitter is a user-hostile trash fire. “The lesson: on a fundamental level, solutions to these games are low-dimensional. No matter how hard you hit them with from-scratch training, tiny models will work about as well as big ones. Why? Because there's just not that many bits to learn.” | |||||||||||||||||
| |||||||||||||||||