Here's the issue I mentioned, the base of each stud is swedged or flaired out to lock the drum on. When you press the studs out it very often oversizes the hub holes.
Correct, the front studs are swaged in place. You can grind that off to be able to remove the stud, and it won't bugger up the hole. I used a dremel to get mine out.