Maybe you need new window felts or "cat whiskers" as some call them. These are often worn or dry rotted and can cause the window to seem loose. Not sure of a good reasonably priced place to buy them, but I sholud look into it, as mine are shot also.
If the gap you are referring to is at the...