Weird rear brake noise

Well I thought it was the end of it. Noise is back with a vengeance. Fine going straight but when I make even the slightest turn the drums grind like crazy on the bracket part of the shoes. I checked the axle flange bolts and everything is nice and tight. Would the green bearings have caused the axles to move inward at all? I am thinking about adding small washers behind the drum on every stud to try to push the drum out just a hair.