I feel guilty about something that I did tonight.

I think that i will do that. :D

I would be tempted to mail it to him instead (with his address as the return address as well) even if it is cash. If he wasn't honest enough to turn in a truck he couldn't pay for on his own, you probably don't want him asking the other neighbors if they saw anyone other than the mail man put something in his mail box.
I agree that if he hasn't paid for it then it isn't his to keep (basically stolen property).