There's no set screw as the knob and shaft are made as one unit. I'd try giving it one hell of a yank and see if won't break loose. IDK if the correct knob is being repro'd for your 64. The picture adriver posted is correct for a 66/67 Charger and fit's just about every headlight switch (which you should replace).
