Holley Street Avenger 670cfm to big for 318cui?

I've run a 750 cfm TQ on a 273, As long as the fuel mixture is good, I would not worry about it. I see you have a 4 speed that should help.