Rust repair patches

I have completed welding in my patches in my deck lid and door skin. The car itself has original 1974 paint that will stay on the car when it gets its new paint job.
My question is, after I use the flap wheel to smooth out the welds, do I prime with epoxy first then do my filler work, or does the filler go on bare metal?