I noticed they stop chasing you immediately as you hide behind a rock unlike other creatures who don't lose interest for a while.

More Rhyniognatha Encountering Tips