Mushy brakes 4 life...

If the bearing is not up against the axle shoulder, there is something wrong with the combo/ hardware/ bearing. That has a lot of force on an "inside corner" and you don't want it moving.