| ▲ | oblio 2 days ago | |||||||
> To start making models better again, AI coding companies need to invest in high-quality data, perhaps even paying experts to label AI-generated code. Heh, there's only one problem with that. Training models is very expensive from a power/infrastructure/hardware perspective. Inference is not as expensive but it's still fairly expensive and needs sophisticated layers on top to make it cheaper (batching, caching, etc). Guess in which cost category "high-quality data reviewed by experts" falls under. | ||||||||
| ▲ | Manfred 2 days ago | parent [-] | |||||||
I would hope the trillions of dollars sloshing around are used to pay people to make the core of the product better. | ||||||||
| ||||||||