i built engines for years, silicone with no gasket is the only way to go. i also toss the end seals in the trash and use ultra black RTV there too. use laquer thinner to clean your surfaces first, and you'll never have another leak.
i've never had a issue with the stuff ending up in the engine, you'd have to be really careless with it to actually cause any problems.
i also use it on timing covers, water pumps, thermostat housings, etc in place of gaskets. when you have to fix leaks on a customer engine on your own time you learn how not to have em leak!!
