Should I tear it back apart?

Read here for what can happen if you drill a hole in the gallery plug too large: Crabby oil pressure problem

If it is of concern, remove the timing cover and then the upper passenger side timing thrust plate bolt, and drill a small hole through the bolt, and re-install. No shavings in the engine that way. Or just pull that bolt out.