Do you put drill a small hole in your thermostat?

Yep. Some t stats come with a air bleed.