>It's physically not possible at our current level of technology to make this "safer"

Absolutely it is, if NASA was not constrained by congress to use shuttle components to build the spacecraft, they could have had double the payload mass capability at least (the Saturn V was almost twice as capable, we should be able to do a little better now). This would provide tons of extra margin for safety, and allow a shorter and thus safer route to the moon as well.