Right angle oil filter adapter

I had a very similar problem recently. As scary as it is to crank down on the bolt that holds the adapter on, you may just need to tweek it a little more.
Be carefull though you don't want to break the bolt off!