Should I have an overflow bottle?

My 73 Duster didn't come with a bottle. It would spit water under two conditions (that I noticed, anyway): when I had too much in the radiator and when my head gasket was blown. The head gasket wasn't really a spit, it was a full on flow of water. I would put water in it every couple of weeks in the summer.