I didn't want to hit it too much with emery cloth for fear of making it too much smaller and having the bearing spin. I ordered the Timken bearings and seals and FelPro gaskets.
As long as it takes a bit of effort to press the bearing on the axle shaft, it will be fine. If it doesn't take much effort, but, the bearing still fits snug on the shaft, you can tack the lock ring on the axle shaft as Murray mentioned.
