Fuel pump

When I bought my '65 Barracuda with 273, the fuel pump made a knocking noise and then failed because of dirt from the old fuel tank. The new pump also has the same knock but has worked fine. Is this normal? I don't like the way it makes the engine sound crappy.