| ▲ | greggsy 2 hours ago | |
Maintenance, capacity management and spares all add up, not to mention labour. If they have a requirement to maintain geographical diversity then that moves the needle significantly if they’re primarily based on the other side of the country. | ||
| ▲ | gosen an hour ago | parent [-] | |
I've quickly checked and guestimate of the rental would be ~250-300k per month for this kind of usage they claim to have. It's all based on open prices from together.ai. So probably it worth the switch for them afterall, I can imagine that 56 engineers can burn tokens for more than 300k per month | ||