Ouch...sticks out like a sore thumb.

Purple Haze said
To keep from doing it again lock a pair of vise grips around the shaft of the fork, chisel, or punch etc. and use it as a handle to hold while you pound on it.

Yup.

After having to drill a nail or two a couple of times I figured this to be the solution.

Smallest drill bit you can find, worked slowly with the fingers is the way to relieve the ouchy.