Well, it's cracked. How bad is it?

I'd just fill it with JB weld, let it harden, and redrill the hole. Not a huge problem there. There's no stress except what you added trying to get the busted off part out.
I agree that the crack was caused by my removal attempt. Are you saying fill the entire hole with JB and drill a completely new hole the size of the dipstick tube? I must be misunderstanding.