How long did you give the filler time to cure? hours minutes or days?? Bet that is the man problem. Polyester "primer" is sorta like spraying body filer also. Not sure about your polyester sealer.
I use epoxy primer over filler after it has had plenty of time to sure/shrink.
