Gartner Research

Maverick* Research: What Does Good Artificial Intelligence Look Like? Build an {a}IQ

Published: 24 October 2017

ID: G00338724

Analyst(s): Carlton Sapp , Anthony Mullen , Henry Cook

Summary

AI system capabilities vary wildly. We must measure AI quality and suitability for task to avoid overestimating AI capabilities. This approach helps technical professionals and IT leaders consider the issues for assessing AI systems. (Maverick research exposes unconventional thinking and advice.)

Table Of Contents
  • Specific Maverick Caution
  • Maverick Findings
  • Maverick Recommendations

*Maverick Research

Analysis

  • Introduction and Summary
    • Where an {a}IQ Could Have Helped
    • An {a}IQ Measures the Capabilities of an Artificial Intelligence System (AIS)
  • An {a}IQ Is Needed to Reduce Risk and Judge Merit
  • The Rewards of Delivering an {a}IQ
  • The {a}IQ Must Be Multifaceted
  • The Facets of the {a}IQ Align With AI Disciplines
  • The Initial {a}IQ Is a Vector
    • Each of the Facets of an {a}IQ Has Particular Challenges
    • Illustrative Examples of the 2D {a}IQ
  • Expressing the Interaction Between Facets of Intelligence
    • Incorporating Elements of One Facet Within Another
    • Showing {a}IQ Facet Interactions Requires Three Axes
    • Soil Analysis
    • Autonomous Car
    • Visual Recognition of an {a}IQ
  • Risks and Pitfalls of an {a}IQ
  • Recommendations
  • Further Development and Future Research

Gartner Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.