Oil Pan Gasket Question

Do you use the rubber ends or not? I've seen it done both ways. I've used RTV on the sides before but never the ends.
I did use the rubber ends. There is way too much gap on the ends for me to feel comfortable with not using the rubbers.

I am having a real problem keeping the front rubber from popping out on one side or the other, once I get down to the final bit of tightening.

I'm working on a solution now.