How would you handle

Wouldn't that be an assault charge on me??

I can say I have never thought of assaulting a man like that. That would just piss them off and prolly kick my ***.
Yes, it would be assault. Use words, not physical actions.