This pin only comes out one side. A proper size punch from the correct side, tap it out. If it does not move at all, you might be trying from the wrong side. I have had good success doing it like that.
I am assuming that the correct side is from Inside out.
I tried, a little, with a large pry bar, but it was solid and I did not want to bend it. If it is from the inside ( the shaft side) out through the top. I will try the punch and a hammer.
