Need help removing shifter knob on 71 Duster

I can feel the button catching and the knob seems to be releasing to a certain point. Take a look at the pictures