The Pitfalls of Kafka

Apache Kafka is a powerful data streaming platform, but it comes with many limitations. Operating Kafka at petabyte scale requires significant amounts of operational overhead and manual intervention.

Hubspot-LP-WP-Downfalls-Kafka

 

DOWNLOAD the white paper

About The White Paper

In this white paper, we present some of the challenges DevOps teams face implementing Kafka as a data streaming platform. We’ll discuss the fundamental challenges with Kafka’s design, the impact that its constraints have on high-throughput applications, and the difficulty in optimizing Kafka around these constraints.

Our most important concerns in scaling Kafka are:

300x300-LogDNA-Scaling-Downstream

 

  Scaling downstream consumers efficiently
300x300-LogDNA-Redistributing

 

  Redistributing work between consumers
300x300-LogDNA-Handling-Unexpected

 

  Handling unexpected interactions between downstream consumers and live data

 

The information in this eBook is based on this webinar presented by Engineering Manager, Muaz Siddiqui.
This white paper assumes a working knowledge of Kafka 2.0.X or higher. 

You can find the webinar here.

 

LogDNA - Logo
274 Castro St, 2nd floor, Mountain View, CA 94041
  • © LogDNA 2020