I've ran into this many many times, don't grind the bolts down, don't get thinner headed bolts, there thick for a reason: to carry engine torque to drivetrain
most common issue of this is the dust shield is bent, may not appear to be but I guarantee that it is, sometimes I've seen people shim...