Wheel base difference side to side

I've never had anyone tell me it tracked crooked. I'll have to ride behind it. What everyone's saying about the alignment possibly making the difference makes sense. I didn't really notice it until I put taller tires on. I might space it back and if it tracks straight leave it!

If you move the rear axle to change the thrust angle, then to travel in a straight line, the steering wheel may no longer be centered. Since, effectively,the pitman arm is now in a different position than when it was aligned, your toe-in will also be different.
Depending on how far you move it, this may be a non-issue. Or not.