Headlight switch removal. release button not working, 1965 Cuda

I am trying to remove my headlight switch on a 1965 Barracuda. I see there is a push button on the top of the switch that should release the stem and knob. But I have been pushing that button like crazy while pulling on the knob, and it won't release. So, is there more to it, or tricks I could try?

Getting pretty frustrated. I don't mind breaking the switch if needed as long as I can save the stem and knob. Looks like the switches are pretty available.

Any ideas..... ?


Thanks as always,

Rick