Voltage Regulator Problem??

Sounds like you are not getting a good ground on your regulator. Make sure you scrape the paint from the area where the screws go through also use star washers under the mounting screws. The regulator case MUST be at ground potential.