FIREWALL INSULATION

Does anyone else have problems putting in the plastic pins that hold the firewall insulation ? Ive tried a big rubber hammer, grease but no go. Some i can get in just enough to hold the insulation. Some not at all. I dont want to ream the holes out if i dont have to. Any tricks or ideas