Pop one of the rear drums off and lay it in the back of the wheel the way it would mount regularly but now you can see from the back side with nothing in the way. This will either confirm or out rule what I am thinking.
If you do this it will show you why you have a problem.
