This is sort of why I think software development might be the only real application of LLMs outside of entertainment. We can build ourselves tight little feedback loops that other domains can't. I somewhat frequently agree on a plan with an LLM and a few minutes or hours later find out it doesn't work and then the LLM is like "that's why we shouldn't have done it like that!". Imagine building a house from scratch and finding out that it was using some american websites to spec out your electric system and not noticing the problem until you're installing your candadian dishwasher.

▲

mrtksn 3 hours ago | parent | next [-]

> Imagine building a house from scratch

Thats why those Engineering fields have strict rules, often require formal education and someone can even end up in prison if screws up badly enough.

Software is so much easier and safer, till very recently anonymous engineering was the norm and people are very annoyed with Apple pushing for signing off the resulting product.

Highly paid software engineers across the board must have been an anomaly that is ending now. Maybe in the future only those who code actually novel solutions or high risk software will be paid very well - just like engineers in the other fields.

▲

zarzavat an hour ago | parent [-]

> people are very annoyed with Apple pushing for signing off the resulting product.

Apple is very much welcome to push for signing off of software that appears on their own store. That is nothing new.

What people are annoyed about is Apple insisting that you can only use their store, a restriction that has nothing to do with safety or quality and everything to do with the stupendous amounts of money they make from it.

▲

mrtksn 40 minutes ago | parent [-]

It's literally the case of Apple requiring signing the binary to run on the platforms they provide, Apple doesn't have say on other platforms. It is a very similar situation with local governments.

Also, people complain all the time about rules and regulations for making stuff. Especially in EU, you can't just create products however you like and let people decide if it is safe to use, you are required to make your products to meet certain criteria and avoid use certain chemicals and methods, you are required to certify certain things and you can't be anonymous. If you are making and selling cupcakes for example and if something goes wrong you will be held responsible. Not only when things go wrong, often local governments will do inspections before letting you start making the cupcakes and every now and then they can check you out.

Software appears to be headed to that direction. Of course du to the nature of software probably wouldn't be exactly like that but IMHO it is very likely that at least having someone responsible for the things a software does will become the norm.

Maybe in the future if your software leaks sensitive information for example, you may end up being investigated and fined if not following best practices that can be determined by some institute etc.

	▲	zarzavat 14 minutes ago \| parent [-]
		...but the EU is one of the entities forcing Apple to allow other stores. It turns out that Apple is not, in fact, the government.

▲

pgroves an hour ago | parent | prev | next [-]

Thinking about this some more, maybe I wasn't considering simulators (aka digital twins), which are supposed to be able to create fairly reliable feedback loops without building things in reality. Eg will this plane design be able to take off? Still, I feel fortunate I only have to write unit tests to get a bit of contact with reality.

▲

ogogmad 3 hours ago | parent | prev | next [-]

> This is sort of why I think software development might be the only real application of LLMs outside of entertainment.

Wow. What about also, I don't know, self-teaching*? In general, you have to be very arrogant to say that you've experienced all the "real" applications.

* - For instance, today and yesterday, I've been using LLMs to teach myself about RLC circuits and "inerters".

▲

Larrikin 2 hours ago | parent | next [-]

I would absolutely not trust an LLM to teach me anything alone. I've had it introduce ideas I hadn't heard about which I looked up from actual sources to confirm it was a valid solution. Daily usage has shown it will happily lead you down the wrong path and usually the only way to know that it is the wrong path, is if you already knew what the solution should be.

LLMs MAY be a version of office hours or asking the TA, if you only have the book and no actual teacher. I have seen nothing that convinces me they are anything more than the latest version of the hammer in our toolbox. Not every problem is a nail.

▲

array_key_first an hour ago | parent | prev [-]

Self-teaching pretty much doesn't work. For many decades now, the barrier has not been access to information, it's been the "self" part. Turns out most people need regimen, accountablity, strictness, which AI just doesn't solve because it's yes-men.

	▲	wiseowise an hour ago \| parent [-]
		> Self-teaching pretty much doesn't work. For many decades now, the barrier has not been access to information, it's been the "self" part. That’s a complete bogus. And LLMs are yes men by default, nothing stops you from overriding initial setting.

▲

toxic72 8 hours ago | parent | prev [-]

It's more like you're installing the dishwasher and the dishwasher itself yells at you "I told you so" ;)

	▲	lvspiff 8 hours ago \| parent [-]
		I think of it as you say "install dishwasher" and it plan looks like all the steps but as it builds it out it somehow you end up hiring a maid and buying a drying rack.