Who writes those tests and makes sure they test the right thing and everything?

The LLM. And you can use an alternate LLM to antagonize the coding LLM.

You’re simply testing outputs. Make a spec but ultimately ungodly amounts of tests can be built quickly to ensure the program is outputting the right things.