Removing Steering Shaft Bearing

Knocking that lower pin out isn't as difficult as getting it centered when knocking it back in. Best way to get it centered is by pressing it in.
The best way rebuild a column is the way the factory built it. Entire column on the workbench, entire shaft comes out the bottom. You might find upper bearing is crusty too.

This ^^^

I fought with that cross pin wit the column out of the car I used heat and a vice.
IMHO, removing the column is the most direct approach.
Once you have it out you can inspect, clean and replace whichever pieces need attention.
You'll also be able to pull the shaft from the bottom with no need to remove the pin.