Oil pump install with ARP main bolt?

I used ARP main stud bolts and when installing the oil pump the pump hits the bolt leaving about 1/8 inch gap. Should I start grinding? And I really don't want to pull the bolt and remove the washer.

Any ideas?

Thank you