Right side
番 supplies the sound — fān drifting to Pān along an old labial alternation. The 'turn, occurrence' meaning is not transferred;
番 is purely a sound tag. Same phonetic family includes
翻 to flip,
蕃 luxuriant,
藩 fence,
鄱 (place name Poyang Lake).