Best way to replace this line filter cap?

[TheShanMan]

I've got an x1 y2 cap to replace this, but now I'm wondering what is the best way to do this? Do I somehow remove this old one? It doesn't appear to be readily removable? How do I set up the new x1 y2 so that it's well mounted and safe from shorting against the chassis or whatever?