Rocker arm wear pattern

Wouldnt shims move it the wrong way in my case? and yeah thats very true, I remember the geometry on this engine when I yanked it out of a truck last year, was pretty bad.

No. The shims I am talking about are designed to move the shaft toward or away from the valves. Whichever you need.