Remix.run Logo
pixl97 a day ago

With the current demand for GPU time it makes no sense to have your units idle. If you're not selling infrence to customers you'll batch out training to whoever will rent the excess time from you.

Maybe in the future there will be idle time.

datadrivenangel a day ago | parent [-]

The point is that training activity has cost more than the marginal cost of running the hardware, if not, it's better to keep it idle.