> I agree that LLMs are naturally anti abstraction machines.. I'm often trying to find way to reverse that.

I am a bit of an LLM cynic but I am trying to learn it all, and I have to say I have spent most time trying to work out: how do you explain how a brown-field codebase actually works, in such a way that the LLM won't pervert it through misunderstanding.

It does encourage you towards the "conventional" coding standard for any new project, because you want to use a pattern that it will have seen in its training set.

But for example there are differences of opinion in how wordpress plugins (which have a very complex control flow) should be structured. LLMs are incredible at knowing how WP works, actually, but what is difficult is explaining how your methodology for a large plugin is going to work.

It is a battle — but a useful one because it can be used for, er, studying the comparative belief systems of the LLMs.

▲

jbeninger an hour ago | parent | next [-]

The gold standard is code samples. I've got 1000-line convention documents with very simple rules like "Early returns on a single line". Llms sometimes ignore these or misinterpret them in unusual ways.

But if I tell it "read these files that use the same conventions" first, there's no misunderstanding, and the agent also picks up the general "tone" of the code. I have very little to tweak if I've defined the problem well.

	▲	dofm 10 minutes ago \| parent [-]
		> But if I tell it "read these files that use the same conventions" first, there's no misunderstanding, and the agent also picks up the general "tone" of the code. I have very little to tweak if I've defined the problem well. Oh that is a bloomin' great idea, and I can fully see how it might work better. Can't tell you how valuable this comment has been to me and now I feel so much better about evidently kicking a hornet's nest ;-) Thank you so much.

▲

wonnage 2 hours ago | parent | prev [-]

They don’t have a useful belief system, one of the rookie mistakes of using LLMs is asking them what you “should” do

	▲	dofm 2 hours ago \| parent [-]
		Absolutely. I think the bit I still struggle with is finding a way to get them to join my team (which is a team of one very tired person). A story I like is that in the now lost era of handwriting recognition on PDAs, Jef Raskin concluded that the easiest way to solve the problem was to change handwriting so as to meet the algorithm in the middle. That is, to find a noticeable simplification of handwriting that people could learn quickly and that eliminated hard-to-process quirks. I feel I am there with the LLM at the moment, trying to work out what the common ground is.