Door catch striker help

I can't think of any reason for the observed behavior that you can't move the strike straight out.
The hole behind the striker is round and if moved up as high as possible it has to come down to move in or out.