Window plastic rivet replacement

Sedanman said
It is backwards,you drive it in from outside the car and drive it through to push it out

I just installed a new rivet onto my window, but how in the heck do you drive the center pin inward? I pushed with my thumb and it aint moving at all. Do I take a punch and hammer to it? How would I support it from the backside as I hammer it?