They are very difficult to hit in first person, so if you get attacked switch to third person.

More Insect Swarm Encountering Tips