I've had this issue, and a LOT.
One of my addy's changed street #'s for the whole 'hood while I lived there, so 2 different #'s, same street.
I have my college address, which had a box #, and then 3 variations on the same address w/no box #. Good luck finding me on that campus....

My last apartment has a funky zip code issue where the zip is actually for the next city over, so that's wrong, naturally.
I have one address where the street name varies between the address and what the post office has, so there's #### N Blank St, #### N Blank St NW, #### N NW Blank St, and then more variations on these that may or may not include the apartment number. Oh, and the real address from there, I have the same 1st name as the OWNER of the condo, so we've started getting reporting from each other's credit. Yay.
I've gotten a few wiped off EX via online dispute, EQ says they need ID to change them when I sent 4 forms of ID in the mail with the request, and TU changed my current address... to an INCORRECT address, when I SENT THEM THE CORRECT INFO.
Needless to say, address verification is out the window for a moment. Some people say that if you delete all your old addy's, then you're trying to skip. I say that's not so. I have 3 people JUST IN MY FAMILY with my 1st & last maiden name. Anything I can do to limit confusion with other people, I will certainly do. It's my report, not someone else's.
It's also worth it to note that I have not been able to open bank accounts online, mainly due to this address problem. I've also been turned down for CC's & loans due to verification issues--mainly with the address.
Don't trust your financial institutions to get it right. Send in your correct info to the CRA's manually and dispute all others. It's a pain, but you're saving future denied INQ's and grief.