The caps and gaskets can be replaced. I've found that they will develop small leaks over time, or after you remove/tighten them a bunch. The other thing is that the bump on the cap corresponds to a small vent, so, point those toward the rear and not the front. The caps (#42044) and gaskets (#42081) are readily available, and fresh ones should stop any small leaks you may have.
