Potato's are new world crops, as well as corn (maize), chocolate, coffee and a long list of others .
In short, they weren't found anywhere except the Americas until brought back to Europe. They did exceptionally well in Ireland and became a staple crop. (I'm not even getting into the Corn Laws and the Irish potato famine)
But the reality of it is, Paleo man would have eaten anything he found, including a big ol' bowl of ice cream if it were to be presented. If you might get a meal once every other day, you're going to be skinny and not to damn picky. But malnutrition was a way of life for Paleo man.