A Guidance Framework for Testing IoT Solutions

Archived Published: 05 March 2018 ID: G00337181


Not a Gartner Client?

Want more research like this?
Learn the benefits of becoming a Gartner client.

contact us online


IoT solution problems and failures lead to dire consequences. Technical professionals are challenged to test these applications due to immature tool support and diversity in hardware and software. This report outlines key steps and priorities to overcome these testing challenges in IoT solutions.

Table of Contents

  • Problem Statement
  • The Gartner Approach
  • The Guidance Framework
    • Step 1: Create Tests for IoT Endpoints
      • Device Sensors, Functions and Features
      • Real Devices and Variability
      • Understand Your Device Contracts
    • Step 2: Create Tests for Communication Layers
      • Identity
      • Audit Trails
    • Step 3: Create Tests for Simulation Scenarios
      • Simulating Devices
      • The Future IoT Testing: Promise of Digital Twins
      • Service Virtualization
    • Step 4: Create Tests to Validate Aggregated Data
    • Postwork: Report and Refine
  • Risks and Pitfalls
    • It's Difficult to Gain Access to Real Devices
    • It's Difficult or Impossible to Replicate Unusual Scenarios
    • Your Device Contracts Can't Accurately Be Tested By Simulation
    • Your Edge Environment Is Diverse, Posing Compatibility Issues
  • Gartner Recommended Reading
© 2018 Gartner, Inc. and/or its Affiliates. All Rights Reserved. Reproduction and distribution of this publication in any form without prior written permission is forbidden. The information contained herein has been obtained from sources believed to be reliable. Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartners research may discuss legal issues related to the information technology business, Gartner does not provide legal advice or services and its research should not be construed or used as such. Gartner shall have no liability for errors, omissions or inadequacies in the information contained herein or for interpretations thereof. The opinions expressed herein are subject to change without notice.

Free Research

Discover what 12,000 CIOs and Senior IT leaders already know.

Free Access

Why Gartner

Gartner delivers the technology-related insight you need to make the right decisions, every day.

Find out more

Call +1 855-515-4486 or contact us

to become a Gartner client.