To alleviate your concerns - unlike fission, in a fusion reactor the only radiation comes from the active fusion process, and chamber lining that’s been bombarded by radiation. The worst case is a brief spike of neutron and gamma radiation from where the chamber breaches before the plasma collapses, a small amount of short-lived radioisotopes from the chamber debris, and a bit of tritium.

The radiation from the debris would be at background levels in a year or two, since there’s no transutanic decay chains. The tritium would disperse to background levels in minutes, and the radiation burst would only be a hazard in the immediate vicinity.

Not free from issues at all, but compared to a fission reactor the worst-case scenario isn’t bad at all.