Do I need to sand this whole thing down!

With a clean, sound, rust free substrate there is no need to strip to metal unless metal work is needed. I would would apply some good epoxy primer (2 coats) followed with urethane primer (2-3 coats) wet on wet concerning exterior parts. On the inner fenders and fire wall I would scuff it good and clean it following with epoxy then color wet on wet..