Scaleway have two separate (one fully managed one a bit less) services for that:

yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane

	▲	PaoloBarbolini an hour ago \| parent [-]
		They confirmed on LinkedIn that they are working on it. Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...