You can keep them in the cage so they dont run away and get lost while wandering, also makes it easier to access their inventory because they cant move away from you.
Funny Thing:Day 122:I looked at My dung Beetles stats AND IT SAID IT CAN HAVE A SADDLE I LOOKED THE SADDLE UP BUT THERE IS NO SADDLE (Up To make Ark add dung saddle)