A couple of things to check.
There have been instances of new pumps not sitting tight to the main cap, especially when using ARP fasteners. A little clearance grinding on the pump housing or thinning of the bolt head may be needed.
A bit of tweaking to the pickup tube is also not uncommon at all. Heat the tube and carefully bend it so the pickup sits correctly.