▲ | DoctorOetker 7 days ago | |||||||
Due to batching, inference is profitable, very profitable. Yet undoubtedly they are making what is declared a loss. But is it really a loss? If you buy an asset, is that automatically a loss? or is it an investment? By "running at a loss" one can build a huge dataset, to stay in the running. | ||||||||
▲ | dbbk 4 days ago | parent [-] | |||||||
How batched can it really be though if every request is personalised to the user with Memory? | ||||||||
|