Left
方 here is not 'direction' but the residue of a banner waving on its pole, the same element seen in
旗,
族 and
旅. The flag is the indexing element; it sets up the scene of soldiers wheeling around a battle standard that gave
旋 its 'revolve, turn back' sense.