I think that you're correct on the valve keeper/retainer as that will fall in the crank case and into the oil pan when it fails...
If it were a valve seat, it would have fallen into the cylinder and would have beat up the piston top... I've seen that too many times... There would be many small dents in the top of the piston if the debris fell into the cylinder...