First attested in the Yuan dynasty play
《西厢记》 (Romance of the Western Chamber) by
王实甫:
承夫人亲自饯行,
喜不自胜 ('that the lady should send him off in person - he could not contain his joy'). The phrase has been a stock literary expression of overflowing delight ever since.