Gartner Research

Enabling Streaming Architectures for Continuous Data and Events With Kafka

Published: 23 May 2018

ID: G00353112

Analyst(s): Gary Olliffe , Soyeb Barot , Thornton Craig

Summary

Technical professionals struggle to extract value from real-time, continuous data streams. Deploying Kafka as part of a core data processing architecture helps buffer data flow and creates the basis for a reactive ecosystem that facilitates real-time event and data processing.

Table Of Contents

Analysis

  • What Is Kafka?
    • Detailed Kafka Architecture
    • Publishing Data to Kafka
    • Consuming Data From Kafka
    • Kafka Brokers
    • Interfacing With Kafka
  • Why Is Kafka Useful in Data Management?
  • Why Is Kafka Useful for Event-Driven Architectures?
  • What Are the Use Cases for Kafka?
  • What Are Alternatives to Kafka?
  • Strengths
  • Weaknesses

Guidance

  • Deciding on Kafka
  • Deployment Options
  • Scaling Kafka
  • Monitoring Kafka
  • Security in Kafka

Gartner Recommended Reading

©2019 Gartner, Inc. and/or its affiliates. All rights reserved. Gartner is a registered trademark of Gartner, Inc. and its affiliates. This publication may not be reproduced or distributed in any form without Gartner’s prior written permission. It consists of the opinions of Gartner’s research organization, which should not be construed as statements of fact. While the information contained in this publication has been obtained from sources believed to be reliable, Gartner disclaims all warranties as to the accuracy, completeness or adequacy of such information. Although Gartner research may address legal and financial issues, Gartner does not provide legal or investment advice and its research should not be construed or used as such. Your access and use of this publication are governed by Gartner’s Usage Policy. Gartner prides itself on its reputation for independence and objectivity. Its research is produced independently by its research organization without input or influence from any third party. For further information, see Guiding Principles on Independence and Objectivity.

Already have a Gartner Account?

Become a client