Others have mentioned the general pricing, simplicity etc.

Outbound data pricing is a potentially huge saving.

AWS is as much as $90/TB outbound with 1GB free. Hetzner is $1.20/TB (in EU and US) with 1TB/20TB (US/EU) free.

(Good) Smaller places are more likely to have actual technical staff you can talk to.

I have a dedicated server at one provider with $0.30/TB overage, and it's that cheapest I've ever seen. This provider appears to optimize for bandwidth–heavy use, advertising their connectivity heavily.