By this definition if they could instead buffer recent facts and then offload to their weights reliably and efficiently they would be able to accrue knowledge despite their substrate.

Yes, and they'd have to deal with the same problem that we do: how do we know what is true? what gets counted as a "recent fact" and what gets dismissed as mere opinion or disinformation?

In training they get feedback. Out of training, not so much.

Hard problem