Gartner Research

A Guidance Framework for Testing IoT Solutions

Published: 05 March 2018

ID: G00337181

Analyst(s): Sean Kenefick


IoT solution problems and failures lead to dire consequences. Technical professionals are challenged to test these applications due to immature tool support and diversity in hardware and software. This report outlines key steps and priorities to overcome these testing challenges in IoT solutions.

Table Of Contents

Problem Statement

The Gartner Approach

The Guidance Framework

  • Step 1: Create Tests for IoT Endpoints
    • Device Sensors, Functions and Features
    • Real Devices and Variability
    • Understand Your Device Contracts
  • Step 2: Create Tests for Communication Layers
    • Identity
    • Audit Trails
  • Step 3: Create Tests for Simulation Scenarios
    • Simulating Devices
    • The Future IoT Testing: Promise of Digital Twins
    • Service Virtualization
  • Step 4: Create Tests to Validate Aggregated Data
  • Postwork: Report and Refine

Risks and Pitfalls

  • It's Difficult to Gain Access to Real Devices
  • It's Difficult or Impossible to Replicate Unusual Scenarios
  • Your Device Contracts Can't Accurately Be Tested By Simulation
  • Your Edge Environment Is Diverse, Posing Compatibility Issues

Gartner Recommended Reading

©2021 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.