Door handle button sticking

It's not really loose, it's just got that gap there for some reason. I will try that though, thanks!

I know you are new to the hobby, so if you do pull the panel, be careful as they can be brittle.

It might be an optical illusion, but the outside panel right by the handle 'looks' like it may have a small dent?

If that's the case that could be why it has the gap you are seeing.