Changing your own cam bearings?

Bearing materials do get old and brittle, and bearing material can then flake out of the shells, so if the block is original, I'd change them regardless of condition.
I think that's exactly whats happening. 4 out of 5 bearing look fine, but one looks like small areas of the bearing surface have flaked off or something like that. That's why I'm looking at changing them out.