Your right to a point. You always want to keep the velocity high as possible but you also want to allow your engine to breathe there's always compromises to make.
Don't forget 318 heads were actually designed with 273 size in mind. The 318 short block hasn't change much over the years and the hp numbers are pretty consistent even with the addition of the 302 heads it's only when they came out with the Magnum did the 318 gain some real hp.
So unless you like stock power your gonna want to add airflow. The trick is to extend the powerband without moving it from idle. As long as you don't go to crazy with heads it gonna give you more power without loss down low.