Are you certain it's oil? How much oil does it consume and how quickly?
Overly rich or lean mix can "smoke" too. Plugging the pcv on a rich mix will make it richer and smoke more.
Take some pictures of your sparkplugs and post them. If there's oil, it will be obvious.