A855 - 5 Speed

Fourth gear is direct, and as long as the input shaft cannot walk fore/aft this popping out business should not be able to occur
unless there is something going on in the shift-cover.

IMO you need to fix this ASAP before the input clutch-teeth, and slider, get damaged.Then it won't stay in at all anymore.