It's obvious that recursive self-improvement has been happening and accelerating quickly for some time.

AI coding assistants make it much easier to conduct experiments and improve AI models, which in turn improves the coding assistants etc.

Yes but my point is that I never realized that the AI would be writing tools to update the weights directly, rather than improve the existing training process.

That's "just" improvement, not recursive self improvement.