Pulled the Mess that was my Timing Chain....

If I had it that far down, no way would I leave that cam in there. But, different people do things different ways. Good luck.
Are you thinking that something else might be amiss with the cam? Or just the crapped up dowel hole? I don't want to miss any judicious advice here. I suspect the OP is on a budget, so that is the reason to offer some re-use options.