甩手 has two distinct meanings: the literal 'to swing one's arms' (often while walking) and the figurative 'to abandon responsibility' (equivalent to 'to wash one's hands of'). Context determines which is meant.
甩手掌柜 (shuǎishǒu zhǎngguì) is a common idiom for someone who delegates everything.