Paraprosdokians

On of my neighbours has a habit of using the phrase “Ya, No” like he understands the question but his answer is no. Irks me so what’s your answer yes or no?