After seeing someone's pegboard mount for calipers, I had to make my own. This fits my calipers much more securely, and doesn't turn the calipers on when I put them in the holder.

Edit: I've made a better version of this at https://www.thingiverse.com/thing:2617346