| ▲ | lovich an hour ago | ||||||||||||||||
The models don’t exist without training. I don’t see how excluding the training cost from the thing they are selling(inference) is perfectly reasonable and not just an accounting trick. If I am building a widget and have a widget factory that cost money to build and operate, is it reasonable to only use the cost of shipping my widgets to my buyer as the costs for my gross margin? | |||||||||||||||||
| ▲ | maerF0x0 an hour ago | parent [-] | ||||||||||||||||
Generally speaking, IDK about Anthropic specifically, they don't train purely from scratch though. A good chunk of the setup is reused previous models can serve as a basis for the next model. Plus there are methods that also use the previous model as a warm start. Just taking a wild guess, but I'd assume the .5 releases are built on the previous and the Majors (3, 4, 5) are more extensive retrains? | |||||||||||||||||
| |||||||||||||||||