Quarter panel removal?

No I want to take the quarter off get at the rust behind it and replace the same original quarter back on the car.Believe me I really don't want too the car has original quarters. But I don't want to 1/2 *** it ! I can't see getting at the rust the way it should be......thoughts please.