Adjustment ball for rear view mirror hanger

I had the same problem, I smeared it with a little valve grinding compound. That tightened it up and let it move easily at the same time. If something is worn out on yours I'm pretty sure I have an extra one floating around here somewhere.