It only has that depth because you prompt it towards the experts that understand that depth.

An example that happened 10 minutes ago: contracts in racket, it kept arguing that you can't use -> in a contract of a function with a rest argument. I had to mention ... explicitly that it wrote the code correctly.

▲

larsfaye 3 hours ago | parent [-]

Yeah...I know I should be massively impressed, and I am to a degree, but isn't this what we should expect? LLMs can pick up on patterns that no human can see. In that sense, they really are a type of "search engine", but I use that term loosely. Tao is using them as a way to sift and sort theories and information that the model has a plethora of training data on. It's like being able to converse with the codex of humanity, and extract data via an algorithm that is highly adept at sorting through it.

	▲	mettamage 37 minutes ago \| parent [-]
		> It's like being able to converse with the codex of humanity, and extract data via an algorithm that is highly adept at sorting through it. Bingo Thanks for laying it out so clearly. This is what I feel LLMs are really good at yea. Almost to the point that I'd say this is what they are. But I'm not quite convinced that it is that, but it seems to point that way