Could you really build something sophisticated with a local model? Let's say a linux kernel.

I'm using Codex with the Linux kernel and I discard maybe 80% of what it produces. This isn't an area which the top models have solved.