Crabbing

I dont know if you will be able to adjust out a 1/4 inch.
I can tell that 1/4 inch out on the wheel base is contributing to your issue.
Probably has more to do with the squareness of the rear axle in relationship to the front end centerline.
It sounds like it needs to go on a frame machine for measuring and maybe a tug here and there.