Back in the day Direct Connection did recomend the solid state voltage regulator for the mopar ECU.
It was a blue painted version of the solid state regulator made as replacements for Studebakers.
In any event, the VR in your photo doesn't look like a points type regulator. They generally have metal housings and two resistors underneath.
You may already have a solid state regulator.
Dimming lights at a stop on an A-body is not unusual.
A few possibilities to look into:
Changed alternator. An A/C equiped car would have had an upgraded alternator over a plain slant 6 car. But when a replacement was bought - its a crapshoot.
Change in the pulley ratio. Replacements and changes can sometimes end up with a slower turning alternator.
Replacement alternator has a high field current. Sometimes higher output alternators require higher rpm before producing and steal more energy from the system.
Slipping belt. Don't shrug it off. I just had that with my Jeep wagoneer with '94 amp' 12SI alternator. At idle the v-belts (yes two) would slip just enough when the alternator had a high load at idle (lights and brake lights) to force the battery to take over. Simple fix.
You should know that most replacement headlamps draw more current than the originals (6012 bulbs).
A great improvement in lighting can be had by installing a relay system power the lamps directly off the alternator. This also reduces the load on the power connections at the bulkhead and headlight switch connector. It may or may not resolve the dimmer lights at idle.
Two blue wires together at the regulator is unusual for a '68. Is one wire powering the ECU ?
R6 is the alteRnator output wire.
J2 is Ignition Run, blue wire with white striped.
J2A is the branch to the regulator and power the alternator field.