| ▲ | estearum 4 hours ago | |||||||||||||
Actually you'd trivially disprove that claim if you're starting from mechanistic knowledge of how orbits work, like how we have mechanistic knowledge of how LLMs work. | ||||||||||||||
| ▲ | gchamonlive 4 hours ago | parent [-] | |||||||||||||
You have empirical observations, like replicating a fixed set of inner layers to make it think longer, or that you seem to have encode and decode layers. But exactly why those layers are the way they are, how they come together for emergent behaviour... Do we have mechanistic knowledge of that? | ||||||||||||||
| ||||||||||||||