Paraprosdokians

On of my neighbours has a habit of using the phrase “Ya, No” like he understands the question but his answer is no. Irks me so what’s your answer yes or no?
My one friend does that all the time. He doesn't realize he does it I'm sure.