holley 1920 carb question

It sounds like a vacuum leak to me. Try spraying carb cleaner in short bursts around suspected areas (gaskets, etc). The carb cleaner will bubble and get sucked into the leak. That bubbling is the sign of a vacuum leak that is causing your idle problems. Your idle might pick up a little bit as carb cleaner is very combustible.