318 engine noise.

Side to side isn't a problem. Those rockers are almost self centering. A flat lobe or collapsed lifter will be loose pulling up and down and will be noisy at idle or at all engine speeds. As Garry said sounds like a broken motor mount.