| ▲ | lowsenberg an hour ago | |
I'm hoping that hosting providers such as Hetzner will soon offer inference at reasonable prices and hosted in the EU with this kind of framework. | ||
| ▲ | markusw an hour ago | parent [-] | |
They are definitely experimenting with inference, see https://experiments.hetzner.com/ (needs login). | ||