Think this intake swap will hurt performance?

I think once you're boosting, the M1 will help. I Have a mate with a 318 running an M1 with eddies and a turbo. He's gone 12.7@8psi boost with 2.92 diff gears, and a very tame converter. With smaller gears, and more stall it'd go plenty faster I would say.