BB rear main seal retainer

Im no machinist but wouldn't removing that much material from the retainer mating surface distort the seal itself around the crank?