Maybe they are old valve spring keepers that someone who changed springs before you left behind. If all the springs are still intact and it's runnin' ok i would just clean everything out good and seal it back up.
Was there a specific reason you pulled the valve covers in the first place?
The more i look it still looks like a knurled guide.....idk
