Gartner Research

Building Data Lakes Successfully

Published: 11 July 2019

ID: G00378068

Analyst(s): Sumit Pal

Summary

Data lakes provide a flexible data store that helps organizations address data and analytic use cases, but building a data lake is challenging. This research helps data and analytics technical professionals circumvent challenges and align use cases with technologies and architectural best practices.

Table Of Contents

Analysis

  • Architecture
    • Questions to Ask
    • Best Practices
  • Ingestion
    • Questions to Ask
    • Best Practices
  • Storage
    • Questions to Ask
    • Best Practices
  • Data Processing
    • Questions to Ask
    • Best Practices
  • Consumption
    • Questions to Ask
    • Best Practices
    • Challenges
  • Operations
    • Best Practices
  • Governance
    • Data Quality
    • Data Catalog
    • Data Security
    • Data Life Cycle Management
  • Strengths
  • Weaknesses

Guidance

  • Data and Governance
  • Technology
  • People
  • Operations

The Details

  • Ingestion
    • Change Data Capture
  • Storage
  • Data Processing
    • MapReduce
    • Lambda Architecture
    • Kappa Architecture
  • Data Governance
    • Data Quality
    • Data Catalog
    • Security

Gartner Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.