Lifter Swap, is it worth it?

Leave them in. The lifters reduce the duration below 3K. It’s not a horrible thing. It should make the slow cruise easier. It will also most probably help with mileage.

If you still feel a lack of torque down low, improving your exhaust system will yield excellent results without tearing into the engine.