Loanword from Sanskrit 'yoga'. The characters were chosen mainly for their sound:
瑜 (a kind of fine jade) +
伽 (a transliteration character used in Buddhist terms). Came into Chinese centuries ago via Buddhist texts but the modern fitness sense is from the late-20th-century global yoga boom.