> LLMs have made the musician part automated. They'll play whatever you want

I like your metaphor even as someone who can be a bit skeptical of the overly broad promises of LLM’s/AI. But I do think this statement is too generous. It implies way too much actual musical ability. It also means that everything I can imagine musically is possible which it just isn’t, as there are limitations just like with real musicians.

If we want to really make the metaphor work, it’s an orchestra full of very informed people who have read a lot about music and have an idea of what their instrument should sound like and can even make whatever they’re holding sound like the appropriate instrument most of the time sort of. With our direction, our “conducting,” their success goes up.

But ultimately: they aren’t real musicians, they aren’t holding the right instruments, and they haven’t actually been taught how to read music. They are just often good at sort of making it work in a way that approximates what we want.

Yes, I agree, the musicians aren't mystros. And their technique could use improvement.

But I think the analogy holds (from an output point of view), the musicians will continue to improve, and some sections play better than others. The overall effect is "pleasing" although perhaps not concert quality.