Remix.run Logo
KaiserPro 6 hours ago

From my estimation each second of gpt eats about 0.5-1.5 watthours

YetAnotherNick 6 hours ago | parent [-]

You can say it takes 1800-5400 W. Not sure where you are estimating it from.

KaiserPro 3 hours ago | parent [-]

Depending on what you're doing its taking up to 8GPUs working in parallel to serve those queries.