overcarb'ed super six??

I would venture that the adapter is causing a vacuum leak. If it idles fine with the choke on then you are getting to much air with it off. Either the idle circuit is lean or you have a vacuum leak. There is no way the adapter plate or intake holes are causing that much of a restriction at idle speed.