Do I need a new welding guage?

Mine do the same, there are sometimes a teeny, tiny leak that might be hard to find, I don't worry about it unless you use the thing all day so that you might lose a little gas. If it takes days for the gage to go down the leak is pretty small and if you shut off the tank you're not going to lose much anyway.