the little rubber piece thats on the end of the master cylinder pushrod?

It holds the push rod in and keeps it from falling out. If you lifted the brake pedal with you toe the push rod might fall out of the back of the master cylinder.

Dr Diff sells a replacement.

Mopar Manual Brake Push-Rod Retainer, Bushing, Clip Rubber Grommet