Help with Green bearings RP 400

With OEM axles there is a good chance that the buttons will need to come out. Often the two axles touch the button and you can't install the outside wheel bearing covers without distorting them. Might as well remove it now, right?