You just made me wonder if REPL driven development and LLMs can be better combined somehow.

This is already a strong theme in the Clojure ecosystem, e.g.:

https://github.com/BetterThanTomorrow/calva-backseat-driver