Remix.run Logo
▲ tomaskafka 3 hours ago

Great term/concept to have at disposal!

Btw, this is why I believe current models with their 128k - 1M context size limits end up creating decoherent systems. They don't have the capacity to see the big picture above some complexity level, and end up doing lot of local optimizations that decohere the system.

▲baxtr 3 hours ago | parent [-]

I agree. Although local optima is what most humans already operate on. So it’s sounds like an engineering solution could be possible since group of humans are also able to divide and conquer complex systems.

▲tomaskafka 34 minutes ago | parent [-]

I agree, but that seems to no longer be an engineering solution, but management/org design solution.