Grinding when shifting -sometimes-

I have an interlock style a883 with a hurst shifter. The car drives great when in gear, doesn't slid out of gear or anything. Only problem is, it's kind of a tricky shifter, me and my buddy are kinda the only people who can drive it good. I always thought it was normal but I guess after having a few people drive it they all think it's funny.

The car sat for 15 years before I got it, then I just decided to take it all apart, go through it all and then put it back together nice and fresh.

The only issue I noticed is sometimes the car will grind going into gear, like only going into 1st gear, reverse, 3rd. And this I just sometimes, mainly it's just 1st and reverse, this is from neutral as well. Someone told me it was linkage, I think it might be the shifter, it was old and nasty, all I did was regrease it, might need a rebuild.

Any ideas? It does it about half the time. I don't want to hear anymore grinding haha