1974 Duster Idler arm question,

Well I figured out after looking at a new idler arm that the one on my car is missing the two smaller rubber/foam bushing and the washers, it does have the one thicker bushing on the bottom. The idler arm seems solid (no wobble) just moves up and down so I think I will add some washers to replace the missing bushings and washers. Do any of you foresee an issue doing this?