You could just redrill the cam bearings themselves. But I do not know your entire plan.
Ideally I would try to have the set screws drilled in a lathe and to avoid breakfast nag bits you should have some pretty good rpm.
What size hole are we talking.
