1980 360 La oil pump pickup tube install

and it just comes out?
Yes. You may have to rock it back and forth a little but it will come right off. The important part is installing the pickup correctly. It needs to be touching the bottom of the oil pan slightly when it is in the correct place. That's with the oil pan gaskets in place.