Probably not, but why not check that possibility? Just disconnect the vacuum source and plug the tube (so no leak to manifold). Without vacuum, it should add no force to the brake rod, just what your foot applies.
In my experience, grabbing rear drum brakes are usually due to leaking fluid on the shoes, either brake fluid or gear lube. However, that isn't the OP's problem.
