Left altar radical, side-form of
示, picturing a stone altar where offerings were laid for the spirits.
祛 originally meant a ritual driving off evil or disease, so the spirit-altar root tags it as religious action. Same family:
祭 sacrifice,
福 blessing,
神 spirit.