| ▲ | LUmBULtERA 10 hours ago | |
The API inference cost to customers is not the actual cost of providing inference, and the cost of providing API inference need not be the cost of providing subscriber inference. | ||
| ▲ | brandensilva 6 hours ago | parent [-] | |
This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference. | ||