Gartner Research

Hadoop Evolves to Face New Challenges

Published: 11 December 2013

ID: G00257909

Analyst(s): Nick Heudecker , Merv Adrian

Summary

Version 2.x of Apache Hadoop enables greater scalability and availability and expands beyond its batch processing roots to encompass new workloads and processing styles. These changes offer new opportunities for information managers, but complicate support models and the vendor selection process.

Table Of Contents
  • Impacts

Analysis

  • Addressing Storage, Scalability and Availability
  • Moving Beyond MapReduce with YARN
  • Progress of Related Apache Projects and Third-Party Vendor Entry Help Launch the BYOH (Bring Your Own Hadoop) Era

Impacts and Recommendations

  • Improvements allow handling larger, more complex projects and consolidation of disparate clusters, resulting in possible cost savings
  • Multiple applications are now supported in a single Hadoop cluster, but introduce vendor and workload management questions
  • Additional Hadoop 2.x-related Apache projects and third-party offerings will enable more business uses, but create architectural complexity and vendor management challenges

Recommended Reading

©2020 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client

Learn how to access this content as a Gartner client.