Fuel Pump Install

While my alternator is off and I am doing some work on my Duster, I figured it would be a good time to upgrade the fuel pump to something non-stop (Edelbrock 1723)

Is it as easy as removing the stock pump and installing the new one?

Was just concerned about something falling out of place inside the motor where the pump arm extends........

Thanks