How do you get the dowel out of the steering column?

This is a tapered pin so it goes in and out only 1 direction. With master spline at top, pin goes out toward door.

It actually went out towards the passenger door, but you're right... it was tapered.