Stop in for a cup of coffee

I think it has more to do with speed,too much and bit bites and jumps around.
You do need to be careful with 6" bits. if they are tight in the collet and don't wobble when free spinning they shouldn't wobble when cutting. Let the bit do the cutting and not rpm or force.