Loanword from Sanskrit 'yoga'. The characters were chosen mainly for their sound:
瑜 (yú, a kind of fine jade) +
伽 (jiā, transliteration character used in Buddhist terms). Came into Chinese centuries ago via Buddhist texts but the modern fitness sense is from the late-20th-century global yoga boom.