will a bigger cam kill the torque?

First thing you need to do is NAIL DOWN that compression. Sayin "it's between this and this" ain't gettin it. Thirty years ago, that might have been good enough, but with today's modern cam grinds, you need to know your exact dead nuts on static compression ratio or you will never acheive the peak power for a given combo. If you really want a good camshaft recommendation, then you need to be blueprinting that compression ratio. If you're really serious about it, that would be up to and including removing the heads to get it done. It's really no that bad a job on that motor at all anyway. You might can get "in the ballpark" without removing them, but that is really the only way to get it right on the money.