携手 is formal and poetic. It's a favorite word in official speeches, business partnerships, and diplomatic language.
携手共进 (xiéshǒu gòngjìn, 'join hands and advance together') is a classic phrase. In romantic contexts,
携手一生 means 'hand in hand for a lifetime.'