5.9 magnum damper not true

Hi
This is a 1998 motor. I was underneath and noticed a wobble. The pulley and all else looks good, but the outer part isn't on straight. The outer part of the damper that is attached to the rubber. It's got about an 1/8" or so of wobble. I'm wondering if I can straighten that piece with a pry bar or hammer. And if it needs to be perfectly true. Here is the part I am looking at. Any knowledge is appreciated.
Hughes Engines

Don’t wait till it comes off while driving.
It sucks.