extremely expensive

No. CSPRNGs can be pretty competitive these days: https://github.com/google/randen

Yes, in some cases that’s still (a bit) too slow or too much code but best to benchmark first.