My 315 poly keeps running after everything turned off..

I did not mess with the stock wiring. Only thing I did was not use the ballast that is on top of coil. Because that reduces volts down to 6 or 7 for the points ignition. The electronic ignition needs the full 12 volts. I think it's probably the voltage regulator acting up. Today it turned off just fine.

The only thing I'm trying to figure out now is fuel pump. I have a fuel pump relay installed. I'd like to some how have the pump turn on only when cranking or engine running. Is that possible?

The starter selinoid us on the inner fender and is new, and wired according to shop manual wiring diagram.