Bottom indexing arrow radical (Kangxi #111) — a pictograph of a feathered arrow with shaft and barb. The arrow flying away gives the perfect image for the particle's job:
矣 marks the completion of an action, the arrow already released. Same radical family:
知 (to know — words like arrows from the mouth),
短 (short, an arrow's length),
矩 (carpenter's square).