| ▲ | apwheele 5 hours ago | |
Question for the crowd -- with autoscaling, when a new pod is created it will still download the model right from huggingface? I like to push everything into the image as much as I can. So in the image modal, I would run a command to trigger downloading the model. Then in the app just point to the locally downloaded model. So bigger image, but do not need to redownload on start up. | ||
| ▲ | newzino 3 hours ago | parent [-] | |
[dead] | ||