Full-form 肉 sits at the bottom (rather than the usual ⺼ side-form) and is the indexing radical. Meat under a roof spoils - the literal seed of rotten / decayed - and the radical also explains why bean curd 豆腐 is written with this character.
The slanting roof on the upper left frames 腐 as something kept indoors - a shed or storehouse. Food left under such a roof is exactly what spoils, an apt visual for the rotting and fermentation senses.
Tucked under the roof, 付 supplies the sound, shifting from fù to fǔ. The original 付 (a hand passing something) is irrelevant here - it is recruited for the rhyme that links 腐 with 府, 附 and 俯.