HELP - vibration in the driveline

ugh, a bit frustrated, the driveshaft is out, i have my manual for the car, and it says to remove clips and what not, but the part of the ujoint attached to the driveshaft itself does not want to remove itself.

i am dismayed because the front looks like it will be the same bit problematic, is there some trick to gettin it out?