In 73 and later models the fan speed select switch doesn't have an OFF position. Off comes from a separate switch that is operated by the upper sliding lever.
If my memory serves correct the blower motor has a hot wire from there and all controlling is done on the ground side of the circuit.