might be a symptom of writing complex code. I'm sure on basic CRUD they can figure out most bugs since most of them have happened 1000 times before.

I doubt it, a lot of what I use llms for is on the very edge of what these models are trained for.