My weird temp sensor mount

If I go the route of drilling and tapping the cylinder head, does the head need to be removed from the block?

No. Just remove the thermostat housing and stat, put a good magnet under where you'll be drilling, and proceed as Tooljunkie describes.