It is probably due to your clothing choices, Most clothing especially the crafted or 'good' stuff comes with a penalty to mobility. Which directly affects your maximum amount of stamina.