What typically causes this is either bad ignition switch contacts or a bad connection at the bulkhead connector. The reason the lights are staying on is because by using a temporary jumper you are bypassing the ignition switch. When you install the relay you won't have that problem because it will remove the battery voltage from the ignition terminal of the regulator (just like removing the jumper).