Harbor freight mill and lathe question

I have a big drill press here and I wonder if I could rough out these header adapter plates with a 1/4 inch end mill bit and finish them off by hand with a carbide burr. 3/8 inch thick aluminum