If you take too long in killing it it will hit you and continue running (in my experience) but rest assured, they won't do it if you don't attack them for too long.

More Moschops Encountering Tips