I wonder what the "waves" in LLMs are; The global firing patterns that can help us interpret what the weights are doing en-masse

Care to define 'waves' in this context?

I suspect, if our conscious experience === the waves created by neuron's firing, that the hum of the GPU when running a LLM doesn't have the dynamic range to meaningfully talk about having a conscious experiences.

But that's armchair conjecturing.

I thought this research had already been done and published by Anthropic. https://www.anthropic.com/research/tracing-thoughts-language...