$1/hr sounds suspiciously close to a price of one A100 80GB GPU.

Maybe an 8x node assuming batching >= 8 users per node.