Front STUDS are normally expanded "like a rivet" to hold the drum on, maybe you are interfering there. "Swedged" Ignore the "type" of drum here, the front hubs work the same
There is a special cutter tool you can get, I think it was RustyRadRod used to talk about using a 5/8? hole saw with the pilot drill left out
