Steering column collar problem....HELP!

Im in the process of converting my auto on the column to auto/manual in the floor and I have got the steering wheel off and took the screws out of the turn signal cam and the screws holding it to the other collar and the snap ring around the steering shaft and once I tried to pull the first collar off it started to pull the steering shaft with it. Do I need a puller to get the first collar off?