The right-side 阝 is the city radical 邑 in its right-hand form. On the right it always means a town or administrative place, marking 鄱 as a geographic name.
番 carries the sound, drifted from fān to pó. The whole left side traces back to an old place name 番邑 that the right-side city radical then marked as a settlement.
