RPM goes up when brake pedal is pressed?

Can anyone tell me why when I put my foot on the brake pedal my engine increases in RPM. I don't have a tac but I can hear it. Is this a sign of a problem with my brake booster?