You are correct. Radioactive materials from fusion reactors are not a significant environmental threat. The bigger problem with fusion reactors is that nobody has yet built a controlled terrestrial fusion reactor that produces net power.