Errrrrrr, I hate when that happens

From your description the solenoid is getting juice but not activating, not throwing out the drive and engaging the rest of the starter. You need a new solenoid.