Bazaar gear typically isn't the absolute best gear for questing, although it certainly does help you pull through. Agility, for Swashbucklers, boost their chances at getting a critical attack, boosts their attack damage, as well as power damage. It is for Swashies what Will is to Privateers and Witchdoctors, or Strength to a Buccaneer. All you're gaining by gear farming is maybe a power card or two; all Swashbuckler gear will still have agility, possibly weapon power, dodge, or even a little armor.