Remix.run Logo
swiftcoder 5 hours ago

It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy

eliaskg 3 hours ago | parent | next [-]

OVH already provides this → https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalo...

It works great.

someone4958923 3 hours ago | parent | prev | next [-]

IONOS (1&1) also offers inference hosted in europe/germany: https://cloud.ionos.com/managed/ai-model-hub

npodbielski 2 hours ago | parent [-]

No Qwen 3.6? Why?

hoppp 4 hours ago | parent | prev | next [-]

Scaleway does that already but competition is always good.

Aldipower 3 hours ago | parent [-]

Does not scale in my pocket unfortunately.

5 hours ago | parent | prev | next [-]
[deleted]
sofixa 5 hours ago | parent | prev | next [-]

Scaleway have two separate (one fully managed one a bit less) services for that:

https://www.scaleway.com/en/generative-apis/

https://www.scaleway.com/en/inference/

jonas_scholz 5 hours ago | parent [-]

yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane

PaoloBarbolini an hour ago | parent [-]

They confirmed on LinkedIn that they are working on it.

Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...

jonas_scholz 5 hours ago | parent | prev | next [-]

agree. I have a usecase for a bigger open-weight model hosted by an EU company and the selection isnt really great, hard to make the regulatory gods (and the devs) happy at the same time right now

t857295612 an hour ago | parent | prev | next [-]

[dead]

atherton94027 3 hours ago | parent | prev [-]

Never understood why hetzner gets brought up so positively here when there are dozens of EU competitors who are just as good and don't run 7 year old discounted servers

swiftcoder 26 minutes ago | parent | next [-]

> don't run 7 year old discounted servers

That's a pretty big part of why, honestly. How many of us are running server workloads that actually need the price/performance tradeoff of cutting edge server hardware?

MathiasPius 3 hours ago | parent | prev [-]

Because nobody ever mentions them by name, leaving all of us in the dark.

atherton94027 3 hours ago | parent [-]

Upcloud, Scaleway, Clever cloud, etc.

ffsm8 2 hours ago | parent [-]

These are all solid choices, but significantly less performance/€

Understandably too, because hetzner is running things on consumer hardware vs the enterprise hardware the others use