You can use an adjustable axle retainer on both sides (normally only on 1 side) to center the axles and and maintain the total axle end-play needed. Will it be enough? Try the solutions mentioned above.
Edit: Maybe just try putting the adjustable on the D/S and see if it pushes the P/S out enough.