Go into third person (hold down the “map” button on Xbox) and hit them with a torch. WARNING- if there are to a lot of swarms, you’ll need to repair your torch because they will break really fast.

More Insect Swarm Encountering Tips