valve cover trouble!

i tryed a thick felpro gasket but the shaft still hits enough so i cant line up two of the holes. i wonder if i could grind off a little of the material inside the cover to make it fit?