usage
Shortened form of the full saying 麻雀虽小,五脏俱全 ("the sparrow is small, yet all its organs are complete"). The full form is often spoken; in writing, the first half alone serves as a known set phrase.
memory
Think of a sparrow: tiny bird, but it still has a heart, lungs, liver - nothing missing.