What would you do?

Man, you can fix anything. The biggest reason anyone replaces sheet metal is to save time and or labor cost. If you have enough time and you know how to do it, go for it! You will be rewarded in the end with a great sense of accomplishment and a fixed hunk of quarter panel.