rear drum brakes issue

Thrust button / Thrust spacer may be different depending on which unit you are using. I'm thinking you are locking up the differential by tightening the axles into the thrust button too much and stopping them from moving
Op said issue only happens with the wheels installed. That suggests the axles turn freely otherwise.