Is this the fitting you are talking about?
If so, there are two o-rings. Larger for the upper and smaller for the lower hole. If I recall, the existing were not O-rings. The cross-section was square.
Mine leaked also, so I replaced it with regular O-rings. It stopped the leaking. By...