Vacuum does have a temperature; it has a blackbody temperature.

https://en.wikipedia.org/wiki/Black-body_radiation

It has nothing to do with the movements of atoms, but just with the spectrum of photons moving through it. It means that eventually, any object left in space will reach that temperature. But it will not necessarily do it quickly, which is what you need if you're trying to cool something that is emitting heat.