Use a spacer before milling the divider every time.
The only thing I would do to the divider is round the edges off with the use of a spacer, except the 4 hole where it wouldn’t matter. Just check for clearance between the spacer and the intake. Mill away what ever protrudes into the bore hole of the spacer.
Open, 4 hole or tapered is the big question.