Fuel pump?

My old 72 Duster was getting very poor fuel mileage, I was checking over the engine, and checking the ignition timing. With the engine running, I noticed that the crimp around the stock fuel pump was leaking. But I didn't see a leak with the engine shut off.