Model inference compute over model lifetime is ~10x of model training compute now for major providers. Expected to climb as demand for AI inference rises.

▲

Glemllksdf 7 hours ago | parent | next [-]

For sure and growth also costs money for buying DCs etc.

▲

howdareme9 7 hours ago | parent | prev [-]

They are constantly training and getting rid of older models, they are losing money

▲

ACCount37 7 hours ago | parent [-]

Which part of "over model lifetime" did you not understand?

	▲	adgjlsfhk1 2 hours ago \| parent [-]
		That's not a sufficient condition for profitability if both inference and scaling costs continue to increase over time.