Top net radical — the flattened cap-form of
网, drawn as a mesh stretched out for catching prey. Supplies the meaning:
罕 originally named a long-handled bird-catching net rarely used outside hunting, and from 'rarely used' came the modern sense of 'rare, scarce.' Same radical sits in
罗 net,
罢 stop,
罪 crime.