Upper A-Arm. Left or Right, does it matter?

Loosen the front upper cam bolt and roll it all the way positive "out at the top". Snug it up. Then roll the rear cam bolt all the way negative "in at the top". Do that to both sides and then set the car back down and see if it looks better. This will give you the maximum positive caster. Hope this helps....

If it looks okay after this, then yes an alignment should take care of it.