words that irk me

When someone says “To honest with you ….” Are you implying you lie to people most of the time??