Maybe I’m misunderstanding something. The way I read the results, I understand it like this - you give Astra “a bunch of numbers”, and tell it - “hey, this is a net trained on some game? What game is that?” And Astra goes - “Breakout, no doubt!”

To me this is fundamentally different from having ingested a bunch of docs so it now “knows Java” in its weights.

Ah, ok, so basically advanced pattern matching. I wonder if they train models on each other's weights?