| ▲ | tomaskafka 3 hours ago | |||||||
Great term/concept to have at disposal! Btw, this is why I believe current models with their 128k - 1M context size limits end up creating decoherent systems. They don't have the capacity to see the big picture above some complexity level, and end up doing lot of local optimizations that decohere the system. | ||||||||
| ▲ | baxtr 3 hours ago | parent [-] | |||||||
I agree. Although local optima is what most humans already operate on. So it’s sounds like an engineering solution could be possible since group of humans are also able to divide and conquer complex systems. | ||||||||
| ||||||||