the great mask debate

I go to dozens of different places of business daily in my job. I very rarely wear a mask when I walk in to the receiving area, and never wear them when I'm outside. If I go to a restaurant I will wear it from the entrance to my table, and when I leave. I do wear one if I go to a store, but I don't know how the numbers keep going up if everyone is social distancing and wearing masks. Seems counterintuitive to me, but I'm no scientist, just a dumb truck driver.
That's the part that makes no sense to me. I would say at least 80-85% of people wear masks when we go out, so how are our numbers still going up?