Its a dance and judgement call. If you have to back it off, grab the rotor and do the wheel bearing test, shake it, shake it good! If sloppy tighten. There are a lot of variables that can effect the pre-load. The nut is a fine thread so backing it off doesn't change much. You can also overload the bearing (as you've seen).
