Voltage Regulator Problem??

I ran a jumper wire directly from the battery to the blue wire ignition terminal on the regulator. That smoothed out the voltage gauge in the car to a steady 14.5 volts. No flickering. When I turned the key off, the gauge lights stayed on! So those lights are feeding from the same place the regulator blue wire is coming from! I'm sure this is causing a voltage drop to the regulator.