Remix.run Logo
simonw an hour ago

Fine tuning LLMs has turned out to be mostly not worth the effort, but I wonder if fine tuning Jev-style models will turn out to be a whole lot more useful.

edot an hour ago | parent | next [-]

But why? Jev-style models seem useful for "I have no clue what my incoming distribution looks like but I need to give some sort of answer". If I know what my incoming distribution looks like I'll just upload a CSV of that into ChatGPT and ask it to fit a basic ML model on my data.

alexmolas an hour ago | parent | prev [-]

If you want calibrated probabilities you'll be forced to fine-tune it