Gartner Research

Managing Test Data for Emergent Architectures and Agile Development

Published: 08 June 2018

ID: G00348342

Analyst(s): Sean Kenefick


Agile teams must adequately test applications and find that keeping data secure and refreshed during the development process is a challenge. This document shows technical professionals responsible for developing software how to apply test data best practices to their development pipelines.

Table Of Contents

Problem Statement

The Gartner Approach

The Guidance Framework

  • Step No. 1: Architect Your Data in Ways That Protect Sensitive Information
    • Use Frameworks That Enable Pseudonymization
    • Avoid Embedding Sensitive Data Into Single Data Objects
  • Step No. 2: Evaluate Your Data Risks Before Testing
    • The Risk of a Breach
    • The Risk That Your Application Won't Be Properly Validated
    • Aligning Risk With Data Procurement Methods
  • Step No. 3: Use Fabricated Data for Development-Centric Tasks
    • Development Experimentation
    • Unit Testing
    • Functional Testing
    • Development Performance Testing
  • Step No. 4: Use Masked Production Data for End-to-End Workflow Testing
    • Traditional Data Procurement Tools
    • Masking Data
    • Integration and Acceptance Testing
    • Regression Testing
    • API Testing
    • Security Testing
    • Performance Testing
  • Step No. 5: Integrate Test Data Management Functionality Into Your Development Pipelines

Risks and Pitfalls

  • Your Test Data Management Tool Doesn't Properly Identify All Sensitive Data in Cloned Production Sets
  • Cloning Large Datasets Takes Time
  • The Use of Fabricated Data Won't Expose All Defects
  • You Might Be Doing It Wrong If You're Using Production Data At All

Gartner Recommended Reading

©2021 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.