512 cid upgrade

So is there such a thing as haveing too much head on a motor?
You know I never realy thought about that.I would think the deciding factor would be intake maniflod.I know the mild porting was good for about 15 HP but that is from a fairly free flowing head to start with