Weird rear brake noise

I wouldn't do that, the axle should not move at all with green bearings. You need to post a pic of where it's rubbing.