It's not that I don't want to go, it's just that I don't have time.
Tips
grammar
只是 has two main uses: (1) 'merely/only' to downplay something (只是随便说说, just saying casually), (2) 'but/however' to introduce a contrasting point (只是没有时间, it's just that there's no time).