Did you try reaching in through the opening when you open the door, as in from the passenger compartment?
I have done it that way, it is a pain like I said. After the third time it popped off I realized I was missing that cap thing to hold it on. :banghead: