Help stop the "clicking"...

If you removed the support bolts and lowered the column, it went back up shifted to one side.

Are you talking about the nuts/bolts that are at 12:00 and 6:00? If so, how do I know if if I am getting it back to square? Is there a trick, do i just count the rotations, or is it just trail and error? THANKS!