aluminum vs steel flywheel for stroker

I don't know how an aluminum flywheel would work in a street car. We ran an aluminum fly wheel in our midget for oval track racing. Aluminum is the only way to go for this type of racing. As you get near the corner you let of the throttle and then give it fuel to set the car, feather around the corner and at a certain point give if fuel for the straight away, repeat until the end of the race. The aluminum fly wheel and high compression dropped the RPM so you didn't have to use the brakes unless someone got in your way.

I'm thinking that driving on the street with an aluminum flywheel would be a pain in the arse due to any time you let off the gas, the engine would really slow you down, where a heavy flywheel would keep the RPM up. It could be a learned technique but in my opinion an aluminum flywheel would be troublesome.

Logically I would assume that at a steady 4500 RPM you would get the same torque and horse power whether you were running an aluminum flywheel or steel one. Incorrect shifting techniques with an aluminum flywheel would lose torque and horsepower over a steel flywheel because of a potential drop in RPM when shifting. An aluminum fly wheel will rev MUCH faster than a steel flywheel. My question would be how many 10th of a second would be gained by an aluminum flywheel and on the street is it worth it?