栗 alone is literary. In everyday speech, use 栗子 (lìzi) for chestnuts. Common compounds: 板栗 (Chinese chestnut), 糖炒栗子 (sugar-roasted chestnuts), 栗色 (maroon/chestnut color).
memory
The character has 木 (wood) at the bottom — it's a tree. The top part 西 (west) is a phonetic component. Don't confuse with 粟 (sù, millet) which has 米 (rice) instead.