Remix.run Logo
▲ YetAnotherNick 4 days ago

Firstly you are assuming $0.048$/hr for GPU, which is highly misleading and you can easily sell it for double(vast.ai is $0.12) as you are forgetting lot of cost like CPU, cooling etc.

Also even if you can somehow fit a few 100 billion parameter model(like gpt 6 luna or deepseek flash) in 16GB, and magically assume you can run at 200 tokens/sec according to your calculation, the blended cost of it would be around $100, not $1639.