Axle bearings: how to tell if replacement needed

Thanks guys. This is one area in my mechanical skills I don't know a lot about.
With the axles out the outer Bearing shell/ring jiggles around. But is that because there's no pressure on it??..... Hard to explain, hopefully you guys understand what I'm saying