Right-side
午 supplies the sound (wǔ → xǔ, with palatal shift through Middle Chinese).
午 itself depicts a pestle and is unrelated semantically to permission — pure sound borrow. The same phonetic surfaces in
许's classical reading and shows up in some place-names with both readings preserved.
