the little rubber piece thats on the end of the master cylinder pushrod?

To remove the push rod out of the MC. Remove the brake switch, and pull back on the brake pedal.
Pop...Out it comes.

PS: Get the correct rubber grommet, and not a piece of rubber hose, o-ring, bubble gum wrapper.
It's your life we are talking about Brakes are important, get the right part.