I would start by covering the outside mirror, and then body lines with tape.
Pretty much any change in shape of a surface will change the noise at the very least.
Also check around where the top meets the window on that side for loose edges of seal and things like that.
