Check and make sure ALL of your connections are good, tight, and CLEAN. No rust, corrosion, paint, etc. The ground is usually the problem but any of the connections can cause issues.
The regulator could very well be bad even though it's new. That is becoming so common its ridiculous.