Upper A-Arm. Left or Right, does it matter?

i think it would be really obvious if they were on the wrong side. wouldn the ball joint sit really uneven?