I had the same problem but it only occurred when the fender lifted...like when backing down a hill and turning. When the front end was level (ride height) or when driving I didn't have the issue.
Good luck and hope you don't damage your fender like i did. It pulled in when the tire caught it backing down my driveway.