Can I remove PS pump?

Hi folks.
I was wondering if I can remove my PS pump and cap off the box?
this pump has not had or held fluid in manny years so the box is prolly already hurting.
Just.looking to remove some junk under the hood.

Thanks again.