Apache Kafka 1.0 Cookbook: Over 100 practical recipes on using distributed enterprise messaging to handle real-time data

Simplify real-time data processing by leveraging the power of Apache Kafka 1.0

Key Features

• Use Kafka 1.0 features such as Confluent platforms and Kafka streams to build efficient streaming data applications to handle and process your data
• Integrate Kafka with other Big Data tools such as Apache Hadoop, Apache Spark, and more
• Hands-on recipes to help you design, operate, maintain, and secure your Apache Kafka cluster with ease

Book Description

Apache Kafka provides a unified, high-throughput, low-latency platform to handle real-time data feeds. This book will show you how to use Kafka efficiently, and contains practical solutions to the common problems that developers and administrators usually face while working with it.

This practical guide contains easy-to-follow recipes to help you set up, configure, and use Apache Kafka in the best possible manner. You will use Apache Kafka Consumers and Producers to build effective real-time streaming applications. The book covers the recently released Kafka version 1.0, the Confluent Platform and Kafka Streams. The programming aspect covered in the book will teach you how to perform important tasks such as message validation, enrichment and composition.Recipes focusing on optimizing the performance of your Kafka cluster, and integrate Kafka with a variety of third-party tools such as Apache Hadoop, Apache Spark, and Elasticsearch will help ease your day to day collaboration with Kafka greatly. Finally, we cover tasks related to monitoring and securing your Apache Kafka cluster using tools such as Ganglia and Graphite.

If you're looking to become the go-to person in your organization when it comes to working with Apache Kafka, this book is the only resource you need to have.

What you will learn

• Install and configure Apache Kafka 1.0 to get optimal performance
• Create and configure Kafka Producers and Consumers
• Operate your Kafka clusters efficiently by implementing the mirroring technique
• Work with the new Confluent platform and Kafka streams, and achieve high availability with Kafka
• Monitor Kafka using tools such as Graphite and Ganglia
• Integrate Kafka with third-party tools such as Elasticsearch, Logstash, Apache Hadoop, Apache Spark, and more

Who This Book Is For

This book is for developers and Kafka administrators who are looking for quick, practical solutions to problems encountered while operating, managing or monitoring Apache Kafka. If you are a developer, some knowledge of Scala or Java will help, while for administrators, some working knowledge of Kafka will be useful.

Table of Contents

1. Configuring Kafka
2. Kafka Clusters
3. Message Validation
4. Message Enrichment
5. The Confluent Platform
6. Kafka Streams
7. Managing Kafka
8. Operating Kafka
9. Monitoring and Security
10. Third Party Tools integration

Raúl Estrada has been a programmer since 1996 and a Java developer since 2001. He loves functional languages like Scala, Elixir, Clojure, and Haskell. He also loves all topics related to computer science. With more than 14 years of experience in high availability and enterprise software, he has designed and implemented architectures since 2003. His specialization is in systems integration and he has participated in projects mainly related to the financial sector. He has been an enterprise architect for BEA Systems and Oracle Inc., but he also enjoys mobile programming and game development. He considers himself a programmer before an architect, engineer, or developer.Raul is a supporter of free software, and enjoys experimenting with new technologies, frameworks, languages, and methods.