How much metal flake is too much?

Yes try changing fluid first.

Also before starting remove the rear cooler line and run in a pan then start engine to flush the cooler.