They absolutely MUST be on if you plan on stepping on the pedal. You can bleed brakes without them, but only with a vacuum or pressure bleeder. If you step on the brake pedal without the drums on you can overextend the wheel cylinders, which sets the bleeding process back to zero. Also, that takes a ton of fluid, which is why you're not getting the calipers working right.
