Remix.run Logo
stalfie 3 hours ago

The neural network in the retina actually pre-processes visual information into something akin to "tokens". Basic shapes that are probably somewhat evolutionarily preserved. I wonder if we could somehow mimic those for tokenization purposes. Most likely there's someone out there already trying.

(Source: "The mind is flat" by Nick Chater)

machiaweliczny 2 hours ago | parent [-]

It's also easy to spot as when you are tired you might misrecognize objects, I caught myself with this when doing long roadtrips