I'd definitely pull your reports from a different source (don't buy any scores since they won't match your lender's). Based on your score something else is hurting your FICO score, unless those lates are still reporting and are very recent.