If you're riding something big like a rex or a paracer, they won't attack you unless you touch them.

That being said, of you have a paracer convoy like I do, kill these anyway because they'll probably bump into one of your tames and start a fight.