Improved Rest, the effect that Herbal Tea gives you, does not increase the amount of fatigue you recover during sleep.

All it will do is give you an extra 2% condition recovery per hour, for six hours.

On Interloper difficulty, you only get an extra 1% extra condition recovery per hour.