How would you handle

Tell him the truth, he needs to call before he comes over, he is slowing down your progress and your time is very limited on things you need to work on after your real job, and be no means can someone else come with him. And no, you don’t have time for a tour, he’s seen enough. If you don’t like his company, and you still want to be friends, he has to understand and accept your wishes. If he can’t, it sounds like you can do without him in your life anyway. What he did for you in the past was undoubtably appreciated by you, but that doesn’t mean it gives him an open ticket. And stop the physical contact, period!