Gartner Research

China Summary Translation: 'Questions to Ask Vendors That Say They Have 'Artificial Intelligence' '

Published: 22 March 2018

ID: G00350668

Analyst(s): Tracy Tsai , Whit Andrews


More than 1,000 vendors with applications and platforms describe themselves as AI vendors, or say they employ AI in their products. Application leaders can ask questions to elicit what is AI and what isn't, and what differentiating value is present in either case.

Table Of Contents



Questions to Ask Vendors That Say They Have 'Artificial Intelligence'

  • Key Challenges
  • Recommendations



  • Ask the Vendor to Define AI and ML, and Then to Demonstrate How the Product Uses AI
  • Require the Vendor to Describe How the Product Improves in Outcomes, Including the Documentation of Likely Human Services, and a Frank Evaluation of the Time Necessary for Adding Code or Configuration, or Having to Maintain Models
  • Try to See How AI Makes the Vendor's Product Superior to Others (Extra Credit: Show How Its AI Works Better Than Other Vendors' AI)
  • Inquire What Learning Techniques the Vendor Is Exploring to Enhance the Product (Extra Credit: Determine How to Match Functionality to End Users' Expectations, Including Any Incorporation of Their Results Into the System)
  • Discover What Resources Are Available to Gather Data That the AI Can Work On to Improve Its Outcomes (Extra Credit: Determine How to Adjust for Opacity and Bias in the Dataset)

Gartner Recommended Reading

©2021 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.