Literary, and mostly inside four-character phrases: 所向披靡 (to sweep all before one) and 所向无敌 (invincible) use the "wherever one goes" sense; 人心所向 (the will of the people) uses the "inclination" sense.
memory
所 "that which" + 向 "to face toward": the place or thing one is turned toward.