Buffer/Polisher Recommendations

You are not putting alot of pressure on the drill when polishing, but good to know, yes my press has a morse taper, but the diameter of the wheel is like 1", and I have it running on the slowest speed, like 750 rpms.
I had mine come loose but I was hogging in it pretty hard. Treating it like a mill on some wood.