Help it is grinding bad

What wheels are you using on the car? If they're reproduction wheels, they could be causing the drum to flex inward when you tighten the lugs, and the drum will hit the backing plate. Happened to me.

George