If you give the credit reporting agencies a new address (or any of your creditors do), yes, there are trigger services that go out to certain kinds of companies, including collection agencies. They have to subscribe to those services, though, and they're not free, so if the amount in question is small, it's less likely.
That said, I tend to recommend facing the dragon rather than letting it slumber, but you do as you feel is appropriate.