Well, I would get a new inner seal at this point, pack that puppy with some grease in the cavity to retain the spring and install it, get your gasket thing figured out and so you only need to slide that joker in once and be very slow and careful when you slide it in.
They say the seals aren't required with the green bearings, but I noticed Dr Diff recommends using them. He's the guru.