The 4 step process outlined at the start of this article really reminds me of Deutsch's The Beginning of Infinity:

> The real source of our theories is conjecture, and the real source of our knowledge is conjecture alternating with criticism.

(This is rephrased Karl Popper, and Popper cites an intellectual lineage beginning somewhere around Parmenides.)

I see writing tests as a criticism of the code you wrote, which itself was a conjecture. Both are attempting to approach an explanation in your mind, some platonic idea that you think you are putting on paper. The code is an attempt to do so, the test is criticism from a different direction that you have done so.

▲

card_zero 4 days ago | parent | next [-]

David Deutsch on LLMs:

>LLMs are trained to imitate patterns of language, not to discover or verify truth. So, when asked to speak as an expert in an area where perceived experts have a widespread misconception, the LLM will parrot that misconception, adopting the register and vocabulary of experts.

>This is dangerous when people take that register and vocabulary as conferring authority, or the very nature of an LLM as conferring truth or impartiality, which it cannot. They then amplify and entrench the misconception.

Only distantly related to the subject, but it's in the general area of mental models. I suppose if you're trying to code a cliche, the LLM will help you get it right, and if you're trying to create something original, the LLM will help you get it wrong.

▲

sovietswag 6 days ago | parent | prev [-]

That quote about conjecture reminds me of a big point from Zen and the Art of Motorcycle Maintenance. The author suggests that 'science' / 'the scientific method' don't actually account for the process by which ideas/hypotheses come into existence, science only comes into play once the hypothesis appears (from whence does it appear?). He calls that magic smoke 'Quality'. (Using the language you cited, I guess we would be asking about where the conjecture itself comes from). I'm realizing now that this is tangential to your point, sorry, but thanks for posting this interesting comment.

	▲	crabmusket 4 days ago \| parent [-]
		It's an interesting tangent! I agree with that idea, what we are taught as the "scientific method" does kind of assume you've already had the idea. The method helps you test or criticise it. I don't remember if Deutsch has an opinion on where conjecture comes from, but I think it's bound up with creativity... "quality" sounds like an interesting way of putting it.