You can only get your diploma after passing the graduation exam.
Tips
usage
毕 originally meant 'to finish, to complete' (compare 完毕 'finish'). 毕业 = 'complete one's coursework' - graduation. A 毕业考试 is the test that certifies you've completed enough to graduate.