Raised Port Head Question

So now the question is… mill it off? Will bringing that ledge up (away from the block) not back (toward the shaft) weaken them? Put a stress riser there?