|
| ▲ | sgrove 21 hours ago | parent | next [-] |
| I think it's not going well? I keep getting to the start a new call page, it fails, and takes me back to the live page. I assume your servers are on fire, but implementing some messaging would help ("come back later") or even better, a queueing system ("you're N in line") would help a lot. Really looking forward to trying this out! |
| |
| ▲ | andrew-w 21 hours ago | parent [-] | | We're back online! One of our cache systems ran out of memory. Oops. Agree on improved messaging. |
|
|
| ▲ | yahoozoo a day ago | parent | prev | next [-] |
| Do you use a cloud-based GPU provider? |
| |
| ▲ | sid-the-kid a day ago | parent [-] | | Yes. We use Modal (https://modal.com/), and are big fans of them. They are very ergonomic for development, and allow us to request GPU instances on demand. Currently, we are running our real-time model on A100s. | | |
| ▲ | lostmsu a day ago | parent [-] | | I see you are paying $2/h. Shoot me an email at victor ta borg.games if your model would fit on RTX 3090 24G to get it down to $0.2/h (fellow startup). | | |
| ▲ | tough 21 hours ago | parent [-] | | maybe demos could be a downsampled bitrate/size running on commercial GPU's |
|
|
|
|
| ▲ | ivape a day ago | parent | prev [-] |
| How much would this demo cost you from the HN traffic if you don't mind me asking? |
| |
| ▲ | sid-the-kid 21 hours ago | parent [-] | | Good question. I guess depends on how many users we get. Each users gets their own dedicated GPU. Most video generations systems (and AI systems in general) can share GPUs during generation. Since we are real time, we don't do that. So, each user minute is a GPU minute. This is the biggest driver of the cost. | | |
| ▲ | tough 21 hours ago | parent [-] | | feels like the next logical step for you to bring enconomies of scale is to allow users generating the video to automatically stream it to n platforms, so each gpu can be generating 1 png for many humans to watch simultaneously, with maybe 1 human driving the seat on what to generate, or more ai, idk | | |
| ▲ | sid-the-kid 18 hours ago | parent [-] | | that's a good idea! Would be especially cool if the human is charismatic and does a good job driving the convo. Maybe we can try it out with a streamer. | | |
|
|
|
