340 cam timing, 1.6 rockers?

Yeah, you've got a country mile of piston to valve clearance.
I would definitely put the 1.6s on. It will liven up the torque curve and make up some of the lift deficit you have.