Valve guide trimming, how much

I thought you only had to trim the guides if you had .500+ valve lift.
it's around .450 and higher, valve guides need to be trimmed.