Its the plastic in the over-flow bottles and washer jugs that make them look dirty.
The heat from the engine turns them brown, there is no good way to clean them that I have found.
That's true of most clear or translucent plastics. But the yellowing can look fine if all the rest of the dirt, stains, and grease are washed away IMHO.
