To Stroker a 360 or Not

Gentlemen, ladies, (or whatever you define yourself as) of FABO. I recently bought a 72 Dodge Dart with a 318. It has a 511 lift Voodoo Cam with 2.62 duration and 9.5 to 1 (I don't really know what that means in terms of actual speed). It has a four barrel Holly carb (750) with electronic choke, and headers. It also has a larger than oem radiator and an A833 four speed tranny. I don't know what the rear axle gears are. I have never owned a "fast " car so I don't know if it is fast. The original owner spun the wheels in second gear when I was test driving. I am considering putting in a strokered 360 to make it go faster. Three trusted mechanics from different shops have told me to leave it alone. They've told me that that swaps never end well and I'll always have to be making adjustments. The last guy told me that there won't be that big a difference in speed anyway. He said, "besides, we have speed limits." I thought that was funny. So I guess my question to anyone who has made the swap is, was it worth it? Did the speed change drastically?
First, get rid of your "trusted mechanics".. swaps are no big deal and a good mechanic can and will build a streetable engine, stroked or not.

Then you might want to figure out what you have first first and fine tune it from there and see if you get it where you want it. Wrong cam can hurt more than help, got to have the right gear ratio, right carb?? etc.

I bought mine with a 340 that was done all wrong. Slowly figured out what I had and made changes and it ended up being a really nice running engine. Fast, strong and reliable.
That said, I just put a 410 stroker in over the winter and can't even compare the two. Night and day difference in power. Down right scary if you aren't careful and yet very streetable around town. More speed for sure but hard to tell how much since traction is a major issue now.