Remix.run Logo
▲ onion2k 20 minutes ago

This new era of AI assisted or driven coding is going to help us extend our capability way beyond anything humans could've built.

For individuals, sure. I'm fairly sure we're all building things that we couldn't build ourselves if only because we don't have the time needed. For large scale projects like building an OS from scratch or a database engine that's a lot less likely to be true, simply because there are dozens of examples of humans doing that level of complicated work without AI already (the OSs and DB engines we have are very literal evidence of it.) They just need to work collectively. Every part of those projects is understood people a person even if no person understands the whole thing.

So the problem with doing the same sort of thing with AI becomes a question of whether someone can build the equivalent sort of project with AI by describing something more complex than they understand themselves. And even if they just ignore the complex details and let AI do that bit, how can they validate that the AI has actually done what they asked if they can't understand it? It might have taken a shortcut that works until it doesn't. I hope no one builds an aviation or a life support system by doing that.

Ultimately, I suspect we want to be able to understand the system even if it limits what we build. A system that fails in an edge case carries significant risk which people probably don't want to be liable for.