headlight switch

Yes I have taken them out a few times or so, BUT I can mash in the release button and the stem will not come out! I will rotate but not pulll on out. The tiny wire winding in its reastate were coming out, but I doubt that has anything to do with it.
Any ideas, it has to come out!

I have had to jiggle the crap out of the shaft while pulling it out on some.
Never had to spray or lube them.