If you want to kill these just hit it with a torch, once on fire their hit box will be visible due to the fire animation.

More Insect Swarm Encountering Tips