Installed distributor - Now it makes a bad noise

Check for the loose starter anyway, easy check.

If the starter is OK, then if it has an automatic transmission, check to see if one or more of the torque converter bolts have come loose. If this happens, the bolt head(s) can contact the webbing at the back of the block & it makes a very unpleasant sound.