Remix.run Logo
▲ sshine an hour ago

What do you mean by your custom models? Do you mean custom prompting?

▲sheepscreek an hour ago | parent | next [-]

Guessing - finetuned? Or LoRA?

EDIT: Nevermind, see below. I would definitely go with a LoRA though.

▲AndrewKemendo 41 minutes ago | parent [-]

That’s if I was going to build my own model on myself, which I’m not planning on doing at this point

▲AndrewKemendo an hour ago | parent | prev [-]

Couple things:

I have a “style guide” markdown that is pretty expansive

I run an RLHF style loop with me in the middle for all my writing now where I give a voice rant that is over expressive (aka redundant samples of concepts that I want to express clearly) in order to manage lossy compression steps

Then I will manually clean up that last 5% after a half dozen rounds

That sequence goes into the style guide to be referenced as a reasoning chain of thought to map rant > output

It’s been three years of tuning I’d suspect at this point