Who ya gona call

Is the cap an electrolytic? If they don't have a load they can act as a battery sometimes. Just exactly what does it do, and does shorting the leads or changing the switch change anything?

Actually it looks like you might have TWO electrolytics there

If you have some alligator jumper leads, try shorting first one then the other of those caps