Lifters not moving freely

Ok so Im on the home stretch of putting this 360 together and finally hearing it run and have run into 2 problems and I probably make a seperate thread on the other problem. So as the title reads I have installed my lifters in their bores but just barely. The fitment was very tight and it took a lot of oil to get them in and actually make them move up and down. I did develop and little bit of surface rust in the bores last year before winter but added oil to the bores to stop further rusting and when I go to the engine this year it seemed like the rust was gone oddly enough. But they do not move freely up and down for the most part.

Ive heard of them getting egg-shaped just like cylinder bores do but this is the first time Ive experienced this in my years of building different engines. I do have a honing tool that I could use on them but would they ease up on their own after running the engine? Im a little concerned that if I did hone them that I would do it too much. So what route do I take?