They only travel to you if you have something on your inventory… If you are empty, they will stay on the same place
