The full saying is
桃李不言,
下自成蹊, 'peach and plum trees say nothing, yet a path forms beneath them', because people come for the blossoms and the fruit.
司马迁 quotes it at the end of his life of the general
李广 in the
史记, for a man of few words whom everyone trusted.