drivers side adjustable mirror removal

I'm trying to take off the side mirror on my '72 dart swinger. I took off the one screw and it wont budge. what's up?