904 tranny problems

Could it have something to do with the rear axle I'm still stuck

It could but I see you said you could push it by hand and generally if you can push it by hand things are ok in the differential.

Is the engine in good tune? Fresh spark plugs and points (if it's old enough to have points). Does the engine rev strong in neutral/park? Or does it seem sluggish?