But the problem is, students need to learn to do the easy things themselves before they can do the hard things with LLMs.

If you ask them to build a web browser when they can't do a hello world on their own, it's going to be a disaster. LLMs are like dumb juniors that you command, but students are less skilled than dumb juniors when they start programming classes..