The catch is that for a conventional loan with 20% down, the chance of saving up 50,000 for a home is just not going to happen for me. I'd probably have to get an FHA loan which I was approved for at 621, so what would be the difference at say 670 if I paid all these cards off? Are the interest rates even different for scores when it comes to FHA loans?