USAA is almost always worth getting a quote from. They do have some exceptional offers sometimes. It's not the place to go if you have a 'unique' loan, but at 20% down, it doesn't sound too unique. Quicken does not sell your information. They do lend, sort of. By no means am I endorsing them, but that's Lending Tree types, not Quicken that sells your info.
The lending industry changed when the credit markets changed. I worked at a mortgage brokerage in the early part of the decade just like many people. At that point, broker rates, fees and service was on par with mortgage banks and direct lenders. That's not the case today.
When I talk to broker friends, they're often .375% higher in rate or more, not to mention that their fees are higher. I'm not sure what state you are in, but you will have a few large mortgage-only, well-priced direct lenders. You will find significantly better rates if you ask (1) who underwrites and (2) who funds the loan. If they do that in house, you're probably going in the right direction.
Edited to remove a bunch of white space.
