Carb needs to be primed for car to start

Hey guys, engine is a '64 383, 2 bbl, stock carb (I believe Holley? Didn't look too close but maybe should have).

I filled the float bowl with gas, then ran a rubber line to a jerry can to figure out any idling issues the car may have had. It fired up right away and ran great and idled fine on its own, gave it a few pumps of the pedal and it revved up without problem. After shutting it off, I tried to restart it. Turn the key, starter turns and turns. Pedal halfway down, turn the key, starter turns and turns. Prime the carb again and it fires up right away. Is this an accelerator pump issue on the carb? Any ideas?