How do I get my rear wheels off?

I think the left hand thread was on the passenger side

Nope, the driver's side was left hand thread and the passenger's side was right hand thread.