Used as a sentence-initial discourse marker just like English 'by the way'. Common alternatives:
顺便说一下 (shùnbiàn shuō yīxià, more conversational) and
顺便提一下 (shùnbiàn tí yīxià).
顺带一提 has a slightly more written feel and shows up often in subtitles and online posts.