Removing the entire vent window assembly

I can't see you being able to remove it with the glass still in the door
The glass runs on a slider track that is part of the vent window on one side only looks like it should slide up without removing the window, perhaps it's gaming on the upper bracket, I may have to take the window out?
Anyone else??