Wanted Cone style sure grip internal parts

They are pretty common, the open shafts are a little shorter and a tiny bit bigger in diameter, I have been able to chuck them up in a lath and uses Crocus or emery cloth to reduce the diameter. It doesn't take much.
I did notice the measured shaft diameter was different.
My thrust washers are showing some wear also. Just run them too?
My case, shaft bore is showing some wear also. The shaft has obviously spun in the bore at some point.