Dart wheel clearance issue

I have a 68 Dart with 10" drum brakes. When I removed the front wheel to do some brake work there were wheel spacers on the front wheels. When I put the wheel back on without the spacer the upper control arm lightly rubs the wheel. I verified it has the correct 14 x 5.5 wheels. Can caster/camber cause this issue? How close is this supposed to be?

20160628_191724.jpg

20160627_235735.jpg

20160627_233726.jpg