63 Signet Drivers Mirror Replacement

I picked up a replacement mirror and see that the controller doesn’t fit inside the door hole. Do I have to take the mirror apart or ream the hole? I’m hesitating on taking the mirror apart because I don’t think it will go back the same.

77D6785E-6A52-4C41-BC14-F618A042410C.jpeg