You just didn't hit hard enough. I have a large vice, I rest the pivot with the threaded end in my hand and the smooth end with the sleeve on top of the closed vice, smack it two or three times across the length of the sleeve, and the old piece falls off!