Bushing or not?

I would fully disassemble the column and remove the steering shaft so you can remove that sleeve. That might have been a manual column shift? The auto column shift sleeves just slide out when you disassemble the column.