after upgrading dozens of servers I'd say the biggest pain is if someone installs dpkg package manually and not from a repo

also some very old repos went away over time, so your best bet is to always use the official debian repo, maybe with one extra containing software that should be on that server

with that said, it's one of the painless upgrades you can do