Pulled the Mess that was my Timing Chain....

The dowel pin is designed to be used for alignment purposes ONLY and NOT take the rotational load. Proper tightening and retention of the cam bolt is what fixes the cam gear to the cam by friction. Somehow yours came loose or was not tightened properly.

I just happen to have a /6 cam in my office cubicle today so I took a picture. For your info, the dowel pin measures .250 diameter and it also protrudes from the cam face .25. This is what you need to get back on the road.
It looks like the hole in your cam is wallowed out so that's bad. If the pin is in the pan I wouldn't think it would cause any problems rolling around in there because it won't fit through the pickup screen. (unless it somehow ended up in smaller pieces)

If it was me, I'd replace the cam and not screw around with a repair. New stock replacement cams are available (Rockauto being one source) but then you'd also need new lifters. That would be a couple hundred bucks. Maybe someone on here has an extra stock cam with matching lifters they could donate or sell at a reasonable cost. A new timing set would then get your timing back like new. The one in the picture is headed out to Oregon Cams for a regrind.

One thing about /6 cams is that they are long. You should be able to pull it by raising/lowering,angling the engine to get around blockages in the radiator shroud area after removing the grille, bumper, etc. If you do decide to pull the engine, be forewarned that you are more than likely going to find other problems and things may snowball from there. Good learning experience though!