Which is most important when hiring a vendor?

Pricing, Delivery time, quality and a compelling business case the vendor will stand by

I think it depends on how the category is rated in your category management matrix.  To assist you can do a reverse Porter as the buyer and determine your influence in the category and your dependence on it.  That should be a huge guide to determine the correct evaluation criteria.

All of the above & trust + reputation