I had mine set to 5 points above my then current score. My score jumped 36 points (EQ) and I NEVER got an alert. I adjusted it after pulling a new report and then my score later decreased. Never got an alert for that one either and had to pull another report to get my score. Now I'm getting alerts for things that haven't changed at all. Just got one the other day that an account had changed. Nothing had changed on that account - last month's payment still hasn't even posted for that account. It looks exactly the same as it did before I got the alert. Again, had to get another report to verify that there was no change at all.
I would have never known there were changes had it not been for another monitoring site. Incidentally, I never got an alert on this other site about that account change that Scorewatch gave me. Maybe because it didn't even exist?