Looks really nice. You might consider adding some presets to make it easier to get started, like some common neural net architectures and other use cases for TikZ.

Good idea. There is File > Open Example, but it could be extended for sure. On desktop you can even directly open an arXiv paper!