Fixing A Paint Screwup

Today was nice enought to finally paint some plastic trim. Using my trustly rattlecan I painted several pieces and using a wire hangers hung them on my fence to dry. When I came back out a couple were on the ground and picked up bits of dirt gravel or whatever.
Is fine sandpaper the best way to clean them up for repaint