Buff all you like on a metallic, won't hurt a thing.
What I usually tell people is to wait a month or more to make sure the (single stage/acrylic enamel) paint has cured/outgassed before doing any color sanding/cutting/buffing/waxing. If using an acrylic laquer, you can do it within a couple days.
