Knocking noise

i have a 340 small block and today it started making a knocking noise. Would a water pump make a knocking noise? I took the belt of and the noise seems to go away. The water pump seems to spin pretty freely.