They shouldn't have used anything more than a "dingle ball" hone for a quick deburring. The reason it needs to be done when the engine comes apart is because you run long stiff brushes through the oil galleys to clean them. They run right through the lifter bores and the stiff brush can cause small burrs in the lifter bores, prevent lifter rotation. Not rocket science.
I would do all of them since it's going to be in the jig anyway. properly bushed lifter bores can make more IF the factory ones were off, which they very well could be considering how sloppy the factory machining was back then.