How to restore headlamp bezel?

SpriceyStuff said
So what’s the game plan? I don’t want to try and sand the metal… would painting over the existing paint work okay?

I'd try to strip the black with chemicals only, but check your chemicals and make sure they wont' attack aluminum (Test on the back side first).
Any mechanical action will change the finish on the aluminum.