| ▲ | 1st1 2 days ago | |
can you tell me more about what you mean by generative tests for spec conformance? | ||
| ▲ | midnight_eclair 15 hours ago | parent [-] | |
tests generated based on normative spec to validate if the implementation accepts the right inputs, rejects the wrong ones, produces correctly shaped outputs and to some extend also validates behavior. normative specs allow generation of such tests deterministically - no need to spend tokens, no risk of hallucinations, much higher level of confidence that generated code is correct and much more accurate feedback from the test system into the LLM loop. | ||