> So they've invested around $2.5M-3M into hardware + monthly operating costs (electricity, updates, cooling).

Are you assuming that they bought the hardware? because they could also be renting the metal off a provider, in which case they either pay by the hour or have a yearly commitment to save on costs.

▲

yolo3000 3 hours ago | parent | next [-]

It says in the video that they run them on Together.ai

▲

gosen 3 hours ago | parent | prev [-]

yeah, seems like they're renting (according to the info from the video), but doesn't it make the bill worse? I mean the provider makes money somehow, so it should be more expensive for revolut. I guess it's a lot anyway

▲

greggsy 2 hours ago | parent [-]

Maintenance, capacity management and spares all add up, not to mention labour. If they have a requirement to maintain geographical diversity then that moves the needle significantly if they’re primarily based on the other side of the country.

	▲	gosen an hour ago \| parent [-]
		I've quickly checked and guestimate of the rental would be ~250-300k per month for this kind of usage they claim to have. It's all based on open prices from together.ai. So probably it worth the switch for them afterall, I can imagine that 56 engineers can burn tokens for more than 300k per month