Am I Being Unreasonable? Original Owner Wants Car Back

You have been fair. You don't want to sell it. If he was serious about it, he should say name your price. It would be in his driveway now.

Can't expect to buy a car that is not for sale, for a discount.