Mine is removed and I haven't noticed any difference. Its not to stiffen the car, it simply braces the panhard bar brackets so they don't bend. If you aren't autocrossing, I don't think you will notice it being gone. Also, are you sure the banging is the exhaust? You might want to check that all your mounts are good and tight, but also check your torque arm, both where it mounts to the trans and to the diff.

 

So Patriot, the upper panhard bar is what you removed for clearance of the driver's side pipe, correct? How is ground clearance on your car, is it too bad to be ran with a lowered car?