“Seriously, this is currently bleeding Edge. Things have not even begun to settle yet. We're way too early for the industry to normalize around llms yet”

That’s the exciting part isn’t it? This stuff is completely uncharted water. The interesting thing is there is huge forests of low hanging fruit to harvest too.

The interesting thing is this tickles all the same things “actual programming” does. It’s just the programming language changed to precise English and while the fundamental CS constrains are the same there is a new layer of constraints. Some, like speed of inference, I suspect will be solved (which will be incredible) but others like context management and size will always exist for LLMs. Understanding how little adjustments to what you prompt them can have dramatic changes to their output will never go away. Knowing what to put into context is a hugely important skill.