Voltage regulator

Find the cause. Likely the regulator is doing what its supposed to.
If there is resistance in the circuit, its not going to get better on its own and will cause other problems.