Temp gauge climbs to the max as I try starting the car. Car won't run.

Does the fuel gauge work? They are fed by the same IVR --instrument voltage limiter/ regulator. Try pulling the temp sensor wire off at the engine that should cause gauge to stay "cold."
What kind of ignition system is this? Mopar breakerless, GM HEI module, etc etc
Have you checked spark?

"What do you mean" "replaced distributor?" What was there before, and had it been working, etc

Have you made any wiring changes or repairs?

Bear in mind that "new' (rebuilt) does not mean "functional"

I pulled the wire off of the temp sending unit (assuming that is the little thing on the front of the intake manifold with the stud sticking out) and the gauge stays at zero now. Does that mean I need to replace the unit?

Battery is also completely shot after less than two years. **** O'Reileys. I've never had a battery go out less than three years after I bought it.