| ▲ | colechristensen 3 hours ago | |
>we study a sleep-like consolidation mechanism in which a model periodically converts recent context into persistent fast weights before clearing its key-value cache There is a strong, non-trivial connection here between what your brain does in sleep and what they are studying. You wouldn't object to referring to robot eyes or robot legs. | ||