I use LLM’s to code for me all day but it does feel a little bit like we have really advanced psychic mediums “is there a James in the room, I’m getting a message from someone called Mary…” people have been guessing at the next word and making a career out of it for hundreds of years already.

My mental model of LLMs is as a contractor you've just brought in, every time. They might be very capable but they're starting from scratch on your particular project.