Key stuck in the ignition!!!

This is the second key cylinder/mechanism that has done this to me. I pulled off my steering wheel the other day since I was changing it and went all the way down to the key. For some reason, there is a mechanism to the left of the key cylinder (when looking straight at the column) that has play and binds up hard with the key cylinder, not allowing me to turn the key all the way off and remove it.

I have no idea what the piece is or what it is called...Was hoping this might be a common problem and the part be replaced and presto its fixed. Not a fan of leaving a key in the ignition, so any help with this would be great!

Thanks