Remix.run Logo
torben-friis 4 hours ago

>you take a spec and create tests, every little thing

A spec detailed enough and unambiguous enough to be translated into machine execution deterministically is called code.

Unlike a compiler, AI can build with a spec that is not detailed enough or unambiguous enough: It does so by filling in the gaps with educated guesses.

This is safe if and only if you take the time to later read the output, understand what its guesses were, and judge wether they were acceptable. No AI can do this for you because the truth lies in your original intentions, which it does not have access to.

The jury is out there on how reliable and time consuming this is vs writing the code yourself; it is not immediately obvious that is faster or requires a smaller cognitive load.

hparadiz 3 hours ago | parent [-]

Code is not a spec. It's an instruction set. It can be a spec if you try hard but that's not an inherent property of code. For example you can write code to be a compiler..that makes it a spec. But hello world is not a spec.

As for whether or not LLMs can write unit tests. The answer is yes.

recursive 3 hours ago | parent [-]

Hello world is a spec. The spec says to produce the text hello world on standard output.

hparadiz 2 hours ago | parent [-]

Try running it without a compatible ABI. See how far you get.

recursive an hour ago | parent [-]

Not sure what the point is. We can update the spec with "in the presence of a compatible ABI".

hparadiz an hour ago | parent [-]

All I'm saying is a program isn't VHS. It's a VHS tape. At that point it's largely philosophy. Can you reconstruct a VHS format from a VHS tape? Sure.