The Priority Pass for Visa Elite allows 5 free visits annually regardless of the airline or loyalty program but only applies to participating lounges. Any other visits beyond those 5 would be $27 per person, per visit.
Prestige won't give you priority boarding. It does have a $250 airline credit which you could use for priority access, but it can also be used to just pay for a ticket.
Prestige is the best choice if your trips usually have you staying in a single hotel for 4+ nights