battery draws down

Obviously I'm not the best at electrical but if it was the starter wouldn't it be really hot to the touch?
more than likely, yes - check the "born on date" on the battery.. what you are describing sounds more like battery than starter