迁怒 always implies that the anger is misplaced — the person receiving it is not the actual cause. The classic structure is
迁怒于/
到 + person. It comes from the Confucian virtue of
不迁怒 (not displacing anger), mentioned in the Analects as a quality of the exemplary student
颜回.