The phrase appears in
《史记·吴王濞列传》 (Records of the Grand Historian, Biography of Liu Bi, King of Wu): 'I hope you will repent and start anew' (
改过自新).
悔过自新 is the standard variant, common in court verdicts, parole rulings, and journalism about reformed offenders.