There are many different ways to make an LLM sound more human-like (the author has actually explicitly mentioned ChatGPT sounds more natural). For their public announcements etc. they might as well used specially trained small 24-32B creative writing model or put a LoRA on top of their Haiku. One could also use "antislop" samplers, maybe some encoder-decoder unslopping postprocessing small models etc. Or they simply may have been written by humans.

▲

swiftcoder 2 days ago | parent | next [-]

> or put a LoRA on top of their Haiku

Are there any creative-writing LORAs published for open-weight models?

▲

BoredomIsFun 2 days ago | parent [-]

> Are there any creative-writing LORAs published for open-weight models?

Oddly enough standalone LoRA adapters are very popular in image generation world and utterly unpopular in LLM world - there it is customary just to distribute fully merged models on HF.

Having said that I personally use a finetune of Qwen 3.6, Qwen3.6-27B-Fable-Fusion-711-Uncensored-Heretic, which was was not designed for creative writing per se but is far better than any other 24B-32B model I've tried for writing, let alone awful vanilla Qwen 3.6.

▲

BOOSTERHIDROGEN a day ago | parent [-]

Interesting use case, with so many finetune available at HF, how you determine a good models?

	▲	BoredomIsFun a day ago \| parent [-]
		/r/localllama, /r/sillytavernai for leads and then personal vibe check.

▲

StilesCrisis a day ago | parent | prev [-]

Why would they use Haiku for anything? They aren't paying for the tokens.

▲

BoredomIsFun a day ago | parent [-]

> Why would they use Haiku for anything?

Good enough for essentially blogposts? Easier to finetune?

> They aren't paying for the tokens.

They are paying for electricity, though.

▲

StilesCrisis a day ago | parent [-]

The electricity cost is a rounding error compared to the cost of putting out a press release which makes them look incompetent.

	▲	BoredomIsFun a day ago \| parent [-]
		As I said, why would you use and finetune (burning lots of electrcity, not rounding error) Sonnet if you can cheaply tune Haiku? Press releases do not need advanced skills from LLMs.