Mound radical on the left —
阝 on the LEFT is
阜 (hill, earthwork); on the right it would be
邑 (city), so position matters. The original
除 meant the stone steps cut into a hill or palace mound, hence 'remove/clear away' (clearing the steps). Joins the hillside-and-terrace family:
阴,
阳,
险,
阶.