Gartner Research

Assessing Cloud Data Integration Options

Published: 11 June 2020

ID: G00430089

Analyst(s): Dk Mukherjee

Summary

The proliferation of data across on-premises and cloud environments has prompted organizations to fortify their cloud data integration strategy. Data and analytics technical professionals need to craft an adaptable CDI architecture that optimizes integration of heterogeneous and multifaceted data.

Table Of Contents

Analysis

  • Cloud-Based Data Integration Is an Attractive Proposition
    • Challenges for CDI
  • Proposed CDI Framework
    • Stream Data Delivery
    • Generators of Data
    • Data Replication and Change Data Capture (CDC)
    • Data Virtualization
    • Common Architectural Pattern
    • Batch Data Movement — Enhancements in the Cloud
  • The Hurdle — Need for a Data Reconciliation Engine
    • CDI Adoption Factors
    • ETL
    • Management and Deployment
    • Performance and Scalability
    • CDI Security
    • CDI for Semistructured/Unstructured Data
  • Strengths
  • Weaknesses

Guidance

  • CDI — Enhancements
    • Fundamental Principles
    • CDI Containerization
    • Emerging CDI Domains
    • Requirements of a Reliable and Versatile CDI Framework

The Details

  • How CDI Has Met Some Common Challenges
  • Use Cases
    • IoT Data
    • Clickstream Analytics
    • Unite Real-Time and Batch Analytics Using the Big Data Lambda Architecture, Without Servers
    • Event-Driven Update to an Application
    • Ingest Streaming News Articles and Filter Fake News

Gartner Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.