Changing Steering Box

How hard is it to change the steering box? Right now I've got a 318 with headers, and power steering, but am thinking about changing it to manual steering. I realize I'll have to hoist the engine a few inches and unbolt the headers, but can I just unbolt the steering box and pull it? Or do I have to drop the K member? The car came with the /6 K member and when I changed over to the V8 K member, I remember I had to drop the K member to get the steering box out for some reason. I hope I don't have to drop this one.