3" exhaust reducing down to 2 1/2" after x-pipe

Will I loose any significant power by running a 3" exhaust and reducing it to 2 1/2" after the x-pipe? I will be making over 600hp and it will be difficult to run 3" all the way out to the back. I thought I saw something that mentioned that the first 4' matters most. Thanks Andrew