A man who frequently hold his thumbs behind his belt is taking a 'manly stance' at least stereotypically. This kind of person hold his masculinity dear, and will respond well to flattery relating to it. On the contrary, insulting it will set off an often overdone negative reaction.
