▲ | DoctorOetker 3 days ago | |
The "subconscious" part of the brain processes huge amounts of information, and a lot of thought is actually subconscious manipulation. Conscious attentive deliberate thought is much slower and typically estimated at ~10 bits per second (if that is even the right unit!!!). When I was nude drawing, the first few poses were always very short (half a minute or a minute) and towards the end of a session the poses took longer. Forcing the brain to make quick decisions (and yes, err along the way) is a fantastic method to force the brain to learn, the sense of urgency and the sense of importance are very much related. Reflexive / reaction speed computer games force a player to learn. I believe its possible to upload neural network weights to the human brain by reaction speed games. I agree with your assessment of the driving force behind machine learning (laying off workers), but I believe it will usher in a new Enlightenment era, where the tremendous energy intensive computations to summarize human knowledge into a compressed form of neural weights results in the democratization of all this knowledge (and if those MBA's had this foresight, they wouldn't share those weights at all! unless they secretly "fight babylon from the inside out"). I will soon try this on a smaller model (that has basic ~100-language knowledge). The main issues are transforming the model weights so that all weights are embedding weights (moving the attention and feed-forward weights to token weights), but this requires knowledge distillation, and I know what form I want, but not sure if I have the requisite compute to do it. The second issue is figuring out how many weights per day one can learn. |