I think both of your harnesses are for single-speed motors. I think variable-speed motors require 4 wires: one for main power, one for low speed, one for high speed and one for the park circuit. The ground is provided by the attachment of the motor case to the chassis.
If you wanted to get rid of the connectors, just cut off the old ones, install new female spade plugs and connect them to the switch and motor the way you want.
The black wire on the '65 harness is going to be your battery feed to the switch. It should go through a little circuit breaker mounted to the battery terminal on the switch. In the case of your '66 motor, either the black/white or the white/black wire will be the battery feed to the switch. Does one or the other of those wires go through a little circuit breaker attached to a terminal of the switch? That's the one. Otherwise, see which wire is battery feed with a test light or voltmeter.
Red is going to be the main voltage output from the switch to the motor.
The remaining wire is to power the park circuit.
The built-in circuit breaker should protect you in case you hook up the wires the wrong way, so be sure to include it in the circuit.
I welcome correction if I am wrong about any of the foregoing. Thanks!