I've seen a lot of posts here and there that say "that late is so old it's not really affecting your score anymore anyway"... usually, this is when the late is 5-6 years old.
So... does anyone have a sense of when a 30-day, 60-day, 90-day late doesn't have much of an impact on your score anymore?? I've had a lot of GW success, but I do still have a few lates that I've had a really hard time with... at what point is it no longer really worth my time? I mean, I have 11 charged off student loan accounts that I'm working on and my scores are in the 500s so it's not like I'm fighting for 5-10 points for a perfect score here 
I've got multiple 120s and a couple 150s. In two years I've climbed back to 700 on TU and 680 on EQ. I'm still being held down by some utilization on a couple cards. Hoping to pay them off in a month. According to the score simulator, I'll jump to 710-750 at that point. We'll see.
The two year point was a big one for me. For a couple months, as the major lates were aging past the two year mark, I was seeing jumps in my score.
ETA: I'm not saying they don't count after two years. I'm just saying that it was a point where they started counting considerably less. I'm sure they're still holding me down.
Starting Score: ~500 (12/01/2008)
Re: When do lates no longer really affect score?
In reality, when they fall off. But the older they are, the lesser they affect your score.