You're probably missing the white nylon pad at the top of the back of the pedal, which is supposed to provide a low-friction surface for the sort of back-of-a-spoon shaped lever to ride on. When I still had a car with this pedal, I would've used
this to replace the missing nylon pad. The less expensive "with minor scuffs" one is fine.