Remix.run Logo
nsteel 4 days ago

The scary thing is while a construction labourer knows how to properly lay bricks, an AI's output is reliably unreliable. Does the foreman have to go round checking every little thing on the site? That would be a waste of time. Using these AI tools for anything important is too high risk.

tasuki 3 days ago | parent | next [-]

There exist many problems for which it's easy to verify the inputs-outputs, but much harder to write the functions to convert the inputs into the outputs.

Just write an executable spec and have the AI generate the code that fulfills it. Where is the risk?

BobaFloutist 3 days ago | parent [-]

I guess the risk would be that the cost of compute would explode out of control long before you got a viable solution.

To give a bit of an absurd example, I imagine there's a reason it's not currently worth it to generate the code with a random character generator, even though hypothetically that would get you there eventually. If we consider AI a much, MUCH better version of a random character generator (let's say it's a million times faster. No, let's say that it'll get you the solution in quadratic time instead of factorial time), that doesn't necessarily mean it's actually worth it now.

tasuki 3 days ago | parent [-]

Just time box it then?

BobaFloutist 3 days ago | parent [-]

Ok in that case I guess the risk would be that it simply wouldn't work and you'd lose whatever time and compute happened in the time box. Which would be a pretty cheap price to pay, but I imagine you'd only try it a few times before giving up and using a different strategy.

taneq 4 days ago | parent | prev [-]

> Does the foreman have to go round checking every little thing on the site?

Uh, is that not half of the foreman’s job? They’re there to direct and coordinate the work, resolve unforeseen issues, and to enforce the required quality of work.

nsteel 3 days ago | parent [-]

I'm certain they don't check every brick. In the same way I shouldn't have to check simple maths. Today's "AI" can't even reliably add two numbers, it's ridiculous.