I knew what you meant,lol. And I use the same silicon grease there, as it is so slippery it makes it almost impossible to damage or twist a lip-seal. As the lady on Tv says, I put that sxxt on everything.
Yea, in small amounts it's not going to hurt anything.
Just a little bit of a chemical makup difference, and as long as you don't get loose globs or anything it's fine.
I don't have any hard facts or anything but I know standard brake fluid and silicone are quite different substances.