To express feelings or thoughts that have been troubling you; to confess or share something that's been weighing on your mind.
This phrase dates to the 16th century and draws from the physical sensation of emotional burdens - anxiety, guilt, and worry are literally felt as pressure or weight in the chest area. 'Getting it off' suggests physical relief from removing this emotional weight.
Try Another Word