600 edelbrock secondary bog.

back in the day, guys used to reduce the mass of the counterweights, to quicken the secondary air door opening. It sounds like you need to slow it down a little, but I don't know, off-hand, how you could temporarily add weight to the counterweights to test that theory.
What rear axle ratio are you running? how tall of a tire?
I wonder if there is room to temporarily attach one of those small "button" magnets to the air door counterweights to see if that slows down the sec. air door opening rate, and lessens or eliminates the hesitation. Make sure there is no binding at all, you don't need a runaway secondary!
I saw a pic of an afb, but you mentioned an avs. So what I just said applies only to afb style eddy.