Rattling from a catalytic converter

As the title says, the heatshield on the catalytic converter rattles as heck when the truck is in drive when on the brakes, or reversing. The rivets rusted off and two corners have come loose.

Should I just rip the rest of the heat shield off and, if so, is there a negative to doing so?

Reading online warns of catching fire...

 

I would not remove the heat shield. On mine once the rivets rusted and broke they were easy to knock/twist out even with out a drill. I just clamped it back together with some 1/4 stainless bolts from the hardware store. I have also used the very large worm clamps to wrap the entire shield on other vehicles with stubborn rust.