With your high income of 70k , 20% down, and middle fico score of 646, you shouldn't have a problem getting a loan. Because your middle score is what the lender uses in deciding what interest rate you qualify for, and I was told it depends on the state you live in too, you should be able to get an interest rate in the high 6%.