I have used the emery cloth stuff in a 600 grit to do exactly that before.
It also works really well for a scuffed surface on a journal like the time I bought a Willy's Jeep from a guy that spun a brand new rear main bearing.
I used the cloth to polish the journal and then replaced the bearing.
It spun because they put the bottom half of the bearing in backwards.
