Trying to remove emergency brake clasp

Got all the brakes off on 72 valiant. Trying to get the cable thru the brake plate and there is the metal bung that holds it in the hole that cable goes thru. Tried with screw driver and pliers to squeeze all the little metal edges that are like prongs so it holds it in the plate and won't let it come back thru the other side. Any other way to get this off and cable thru the plate? Trying to take rear axle off.

Thnks