Yeah, I screwed up but will this work?

I wouldn't call you stupid over this and it is likely not so serious as you think. I would expect that if you hit it with an orbital sander, then spray a good sealer on it followed by a high fill primer, sand the primer and then more primer if needed you will be likely near ready to paint. enjoy life, there are worse things you could have done :-)