How do you release an ignition cylinder

I tried the key in multiple positions with no luck. My manual makes no reference to a key and I noticed that when I insert a key into the replacement cylinder, a small lever snaps out and locks into place at the bottom. I would think that would prevent the cylinder from coming out.