Falcon-9 booster landings

These are coming down like JDAM's. I wonder what would happen if the retro rockets didnt fire? would they take out the entire complex with the fuel that never burned?