Can I use 318 exhaust manifold on 340?

Don't want to modify my custom dual exhaust system if I swap the 318 for a 340. Any problems using 1972 318 exhaust manifolds on a 68-72 340? Thank you.