Actually that driveshaft E brake should work WELL because it employs the leverage of the rear gear ratio. I would investigate it thoroughly, bad/ damaged lining, out of true/ grooved/ etc drum, whatever. "When those worked" they really worked better in some ways to the later rear wheel brakes.
