Well you can but the interlock mechanism will be bypassed and so there is nothing to prevent the engagement of two gears at once, if something goes wrong.
And more importantly? there is no detent to keep the selected gear engaged or to prevent over-travel.
