yes, you need to remove the intermediate shaft. There's a bushing in the block that costs a couple of bucks and should be replaced. I took a block to a non Mopar machinist when I was a kid and they processed the whole block and never touched it. I beat on that 340 for years after that so I guess it didn't cause catastrophic failure, but I wouldn't recommend leaving it in.
