use the weight or loose the weight?

I would ditch it. Why carry around about 10# of extra ballast, I doubt you will notice any difference in noise or vibration.