So looks like I have to replace my heater core

If it is a non A/C car, you never touch the dash, the heater box falls right out under. Very , very easy to do.