Remix.run Logo
mapontosevenths 2 hours ago

Neat. That thousand brains site looks right up my alley. If you haven't seen it, maybe check this out: https://www.nature.com/articles/ncomms13276

The idea is that the brain uses what the authors refer to as "feedback alignment" rather than backprop. Even if it turns out not to be literally true of the brain, the idea is interesting for AI.

I also love the idea of grafting on the memory banks. It reminds me of early work on DNC's (Differentiable Neural Computer's). I tried to franken-bolt a DNC onto an LLM a few years back and mostly just earned myself headaches. :)

It's fun to see all the wild and wacky stuff other folks like myself are tinkering with in the lab.