Block out of square

The dowels are going to be on the same plane as they are now......I don't think they will be the deal breaker.
I think I would have the block trued up. Band aids work to get you home , but for the long haul , doing it right just makes sense.