power steering pump problem

I replaced the belt because of squealing and then noticed that when the engine is revved up the whole pump is moving, no broken brackets, belt too tight?
72 Dart, stock 318, any help would be greatly appreciated.
Thanks and God Bless
Bruce