New Pitman Arm Help Please

If the shaft was large and the arm was small wouldn't that cause the issue OP described?
you would never mistakenly be able to get a small arm started on a large shaft