Remix.run Logo
1st1 2 days ago

Read this section, I've just updated it to be more clear, hopefully will answer your question:

https://github.com/1st1/lat.md?tab=readme-ov-file#the-idea

midnight_eclair 2 days ago | parent [-]

> Test specs with enforcement — test cases can be described as sections in lat.md/ and marked with require-code-mention: true. Each spec then must be referenced by a // @lat: comment in test code. lat check flags any spec without a backlink, so you can review and maintain test coverage from the knowledge graph.

if you mean this paragraph - imo that's still too hand-wavy compared to enforcement through generative tests for spec conformance.

1st1 2 days ago | parent [-]

can you tell me more about what you mean by generative tests for spec conformance?

midnight_eclair 15 hours ago | parent [-]

tests generated based on normative spec to validate if the implementation accepts the right inputs, rejects the wrong ones, produces correctly shaped outputs and to some extend also validates behavior.

normative specs allow generation of such tests deterministically - no need to spend tokens, no risk of hallucinations, much higher level of confidence that generated code is correct and much more accurate feedback from the test system into the LLM loop.