I'm thinking I put too small a cam in my 360 Magnum...

Another cam option. Ground on a 109 LSA and a 105 ICL, but install it on a 101 ICL to maintain compression, and use Rhoades lifters to settle the idle down a little.
Elgin, Hydraulic Flat Tappet Camshaft, Chrysler Small Block, 231/231 @ .050, .480/.480, 109 LC - Competition Products