TTI Headers on Early A's & the starter situation

I'm a running a 4 sp with the large flywheel and had to grind a bit of the starter away to get to clear the TTI's. I have the Chrysler mini starter from a dakota.