Weird rear brake noise

I wouldn't do that, the axle should not move at all with green bearings. You need to post a pic of where it's rubbing.
The axle doesn't move but I was referring to how far in the axles sit as opposed to adjustable bearings. Like how they are installed causes the axles to sit farther in is what I meant by that.