You appear to be mistaken on how your credit scores are used for mortgage purposes. First, it is the 850 scale that is used for scoring. Second, and more important, it is your middle score that is used, not the average of the three. So, for you, your middle score is actually 650. (650, 650, 590). Where have you been getting your scores from?

The judgments are very confusing based on your post. Please elaborate. If they are on your reports, but  innacurate, then you should be disputing them. 

How many inquiries do you have? How many are within the last  year?