If encumbered do not fast travel or you will still be slowed despite being empty the only way to stop being slow is to pick up the fjord hawk or die and you can’t always reach him

Also do not travel to a raft as he will put the bag in the water at least that happened to me