For a correct restoration, they do need to be there. Otherwise, you could put a bumper bolt in the hole and leave the brackets off.
I'd think a stock bumper would be rigid enough to not shimmy and shake without the brackets but a reproduction bumper may be thinner and less rigid.
That may affect your decision as well.