Headlight switch

So this afternoon I was taking apart my dash and I couldnt get my headlight switch out. Now I might be wrong but dont you have to push in the button to get the rod and knob out of the switch so you can take it out of the dash? Just need a little help on how to get it out. Thanks.